Navigating Challenges with LLM-based Code Generation using Software-specific Insights