Teflon is the brand name for for the chemical Polytetrafluoroethylene (PTFE). Making PTFE requires PFAS, which are the toxic part. Think of PFAS as little bits of chain varying lengths that get strung together to make the larger PTFE molecule.
The argument you're making sounds similar to something like "Fossil Fuels are safe, it's just the CO2 that's dangerous." PFAS contaminated water being released to the environment is an unavoidable by produce of making Teflon. You can only make Teflon as a solid without suspending the PFAS in water first.
Here's a pretty good video about the history, manufacturing process, and toxicity.
If it's just the bass, sounds like you can play any banger.