I've had great success using this helm chart to install the entire stack into my EKS clusters. Even if you're not using Kubernetes, it's still a useful example for how everything should fit together.
https://github.com/prometheus-community/helm-charts/tree/mai...