In comments at that hearing, held in the San Luis Obispo County town of Morro Bay, several commissioners complained they had been left in the dark on important matters or had difficulty obtaining information from Lester and his staff.
Hundreds of people turned out for the hearing, many from environmental groups who strongly opposed Lester's dismissal.
Susan Jordan of the California Coastal Protection Network warned that Lester's removal could threaten beach access for the public and open a new era of unchecked development.
"There will always be another billionaire who will block access to the beach," she warned, alluding to notorious fights over beaches in Malibu and other celebrity enclaves.
The commissioners insisted they were legally prohibited from discussing their concerns in public.
"It's important that we protect the commission from any liability," Commissioner Olga Diaz said. "And in order to do that we have to withhold information from you because that's the law and that's what we have to do. So, do you have to trust us? Yeah. Do you want to? Probably not."
Diaz's remarks spoke to the skepticism Lester's supporters expressed about the agency's direction during public testimony. Larkspur Vice Mayor Kevin Haroff reiterated a common sentiment that developers would benefit if Lester were removed.
"Dr. Lester has been a staunch defender of our environment," he said. "His dismissal would send a signal that the coast is now open season for developers."
Before the vote, Lester defended himself, saying he has pointed the commission in the right direction. He cited his accomplishments, including an update of the agency's strategic plan.
"I am convinced that we can handle the organizational stresses we face, and one way to do that is to keep our eyes on the prize -- the precious coast of California and its future, for all people and all generations," he said in his prepared statement.
And after the commission's decision was announced, Lester expressed gratitude to supporters.
“It’s been a privilege to serve the commission for the past 4½ years," he said. "If there is a silver lining, I’ve been energized by all the people who came together on this."
Gov. Jerry Brown has remained silent on Lester's fate, saying it's a personnel matter for the commission to decide. All four of Brown's appointees on the commission voted to fire Lester.
This post includes reporting from Katie Orr of KQED's California and Government Desk and the Associated Press.