Having a business plan when starting is crucial as it provides a comprehensive roadmap that outlines goals, strategies, and financial projections, ensuring clarity and direction for successful business execution.