Carnival Corp. reached a settlement Monday with federal prosecutors in which the world’s largest cruise line agreed to pay a $20 million penalty because its ships continued to pollute the oceans despite a previous criminal conviction aimed at curbing similar conduct.

Senior U.S. District Judge Patricia Seitz approved the agreement after Carnival CEO Arnold Donald stood up in open court and admitted the company’s responsibility for probation violations stemming from the previous environmental case.

“The company pleads guilty,” Arnold said six times in a packed courtroom that include other senior Carnival executives, including company chairman and Miami Heat owner Micky Arison.

“We acknowledge the shortcomings. I am here today to formulate a plan to fix them,” Arnold added

“The proof will be in the pudding, won’t it?” the judge replied. “If you all did not have the environment, you would have nothing to sell.”

Carnival admitted violating terms of probation from a 2016 criminal conviction for discharging oily waste from its Princess Cruise Lines ships and covering it up. Carnival paid a $40 million fine and was put on five years’ probation in that case, which affected all nine of its cruise brands that boast more than 100 ships.

Now Carnival has acknowledged that in the years since its ships have committed environmental crimes such as dumping “gray water” in prohibited places such Alaska’s Glacier Bay National Park and knowingly allowing plastic to be discharged along with food waste in the Bahamas, which poses a severe threat to marine life.

The company also admitted falsifying compliance documents and other administrative violations such as having cleanup teams visit its ships just before scheduled inspections.

Seitz at an earlier hearing threatened to bar Carnival from docking at U.S. ports because of the violations and said she might hold executives individually liable for the probation violations.

“The concern I have is that senior management has no skin in the game,” Seitz said, adding that future violations might be met with prison time and criminal fines for individuals. “My goal is to have the defendant change its behavior.”

Under the settlement, Carnival promised there will be additional audits to check for violations, a restructuring of the company’s compliance and training programs, a better system for reporting environmental violations to state and federal agencies and improved waste management practices.