It appears most people do okay when infected with this but some people do very badly regardless of age or health. It is the not knowing which outcome will happen to you that drives the larger problem. There are now lots of stories about young healthy people being put into ICU or worse by this.
The thing is, is because this is a novel virus, no one has any immunity. Even if one doesn’t become severely or deadly ill, they can still be too sick to work for a week or more. Now if a significant number of those too sick to work or having to quarantine are first responders and doctors and nurses, that is a serious problem.
The other key point, specifically when it comes to comparing COVID-19 to influenza is that most if not all healthcare workers get influenza vaccinations and while not perfect, afford some measure of protection in addition to those who have immunity from prior exposure to similar influenza strains. We also have proven treatments for influenza. We do not yet have a COVID-19 vaccination.
And while some like to compare the deaths and serious illnesses (so far) from COVID-19 to other causes of death, remember this is on top of those.