Was Napoleons lack of rifle units really that game changing?

I'm sure this has been asked many times, but just curious about Napoleon and his views on rifles.

Every mainstream army in Europe used them, from Great Britain to Portugal to Russia.

Was Napoleons viewpoint and lack of rifled units really that important in the grand scheme of his armies? If he utilised them would it have changed much, or were they just one of those specilised niche units that were very good at certain roles, but lacking in others?

TIA