Monitoring your jobs using Grafana and the Apache Spark dashboard
Find out how to monitor your jobs using Grafana and the Apache Spark dashboard
Find out how to monitor your jobs using Grafana and the Apache Spark dashboard
Last updated 06th March, 2020
This guide will tell you how you can monitor you jobs after submitting them.
In this guide, we are assuming that you're using the OVHcloud Manager to use the Data Processing platform and you have already submitted a job.
To read an introduction about Data Processing service you can visit Data Processing Overview.
After submitting your job, follow these steps to open its Apache Spark dashboard:
Open job user interface
in the Actions panel to open the Apache Spark dashboard. If you do this right after submitting a job, you will see a warm up page for a few seconds while your job is starting. The Apache Spark dashboard for your job will then start automatically.
After you submit a job to the Data Processing platform, follow these steps to monitor your job using a Grafana dashboard.
Monitor job
in the Actions panel. Data Sources
Add data source
button. My Data Source 1
). Warp10
https://warp10.gra1.metrics.ovh.net
direct
Add
button. Save & Test
button. Click on the Grafana logo at the upper left corner of the page and from the main menu select Dashboards
-> Import
In the import dashboard page, inside the Grafana.com Dashboard
textbox write 11844
and click on the Load
button. (11844 is the ID of a Grafana template that has been created specifically for Data Processing monitoring)
My Data Source 1
from the menu (Or any other name that you selected for your data source).Import
button to open your dashboard. To learn more about using Data Processing and how to create cluster and process your data, we invite you to look at Data Processing documentations page.
You can send your questions, suggestions or feedbacks in our community of users on https://community.ovh.com/en/ or in our public Gitter
Please feel free to give any suggestions in order to improve this documentation.
Whether your feedback is about images, content, or structure, please share it, so that we can improve it together.
Your support requests will not be processed via this form. To do this, please use the "Create a ticket" form.
Thank you. Your feedback has been received.
Access your community space. Ask questions, search for information, post content, and interact with other OVHcloud Community members.
Discuss with the OVHcloud community