Data shows more than 3.9 million households across the country suffered with broadband issues in the last year.