Some suggestions for your problem:
1. Optimize and reduce the size of all images on your site
2. Use additional CDN
3. Use the Wp-rocket plugin or if you use the Swift Performance plugin you should use the Pro version to have full features for website optimization.
4. Choose the right hosting provider and high speed hosting package
It is best to hire people to optimize your website