The issue has been studied by your department of energy who have produced a publication "Life-Cycle Assessment of Energy and Environmental Impacts of LED Lighting Products" :Yes, they are more efficient once they are in the socket. The work needed to get an LED bulb made is phenomenal. ...
The whole thing is more of a question of where the energy is saved or lost. Who gets to feel like they are saving the world.
Summary http://energy.gov/sites/prod/files/2015/10/f27/lca_factsheet_apr2013_0.pdf
Detailed reports: http://energy.gov/eere/ssl/download...d-environmental-impacts-led-lighting-products
I haven't read it in detail, but the simplistic comparison covering the issues they thought were the most significant, is the following spider graph where the impact of CFL and LEDs (2012 technology and assumed 2017 technology) is compared to Incandescents:
LEDs and CFLs seem to have a much reduced impact over their lifetime. I haven't read the report in detail, I'd be interested if you think there are any glaring faults.
From the conclusion:
"The greatest environmental impact after energy-in-use for the LED sources comes from manufacturing the aluminum heat sink, which would be reduced in size as the efficacy increases and more of the input wattage is converted to useful light (instead of wasted as heat). The heat sink is the main reason the LED currently exceeds the CFL in the category of hazardous waste to landfill, which is driven by the upstream energy and environmental impacts from manufacturing the aluminum from raw materials. Recycling efforts could further reduce the adverse impact of manufacturing the aluminum heat sink."
Who would have thought - that from all the things you mentioned, it was the aluminium heatsink that was the greatest issue!