Evolve Development has submitted plans for a multimillion-dollar high-rise development at the former Port Phillip Woollen Mill site in Nelson Place.

Plans show four apartment blocks between seven and 13 storeys high and 84 three-storey townhouses.

Evolve managing director Ashley Williams has been pushing for a priority development panel to be appointed by the Government to fast-track the planning process.

Mr Bracks, a Williamstown resident since 1990, said Planning Minister Justin Madden had made it clear to the developer that Hobsons Bay Council was responsible for assessing the proposal.

Asked for his view on the 13-storey tower, Mr Bracks said:

"I don't think it's going to happen. I think, clearly, with the decision of the minister [and] with the decision-making that will happen at council, you'll see a different, more appropriate development and I think that will be the right way to go.

"The Government's made its decision. It's given the responsibility to the council and the evidence is there that council will have the role and function to determine and advise on what is appropriate for that site; that's already been decided. "I've great faith in the council. They've now assumed the role and responsibilities of a planning authority and I'm sure they will put the interests of the community and the region first and foremost."

Under the Hobsons Bay planning scheme, the maximum height permitted for the woollen mill site is two-three storeys.

"It's the existing code and it's appropriate," Mr Bracks said.

"It has to be determined what is appropriate for this site and I'm sure the council will do a good job of it.

"It needs to be appropriate for the site and for the region and that's what the minister quite rightly has said: that this has to go through a process of the council before any of those matters are considered and I'm confident there will be significant changes over time in the design of that project."

Mr Bracks said legislation protected the viability of BAE Systems' military operations. Objectors fear the future of Australia's biggest defence contractor, which employs 400 people at its Williamstown shipyard, could be threatened by encroaching residential development and the prying eyes of neighbours.

"They are under legislation already and have a planning ordinance which requires that purpose for that use; that's already the case and I assume that will be maintained," Mr Bracks said.