Take Free, Or at Least Low Cost, Advice
Economic Development Corporations
Funded by a sales tax, these are government organizations which promote business in the locality.
Chambers of Commerce
These are private, non profit corporations which also promote area businesses.
These may be publicly or privately owned--often connected to a university--organizations which help new businesses share costs like rent or secretarial service, under one roof. Many also offer management advice. After some period, the new companies then move to their own premises. The National Business Incubation Association nurtures new companies.
Small Business Administration Offices
These are U.S. government entities. The agency has many programs designed to help, including the SCORE, or Service Corps of Retired Executives who donate their time advising new managers.
The state also provides help to small businesses.
Many local colleges and universities also operate small business development centers.