Checking a job's logs in the Data Processing manager's page
Find out how to get your job's logs while the job is running or after it is finished in the Data Processing page in the manager
Find out how to get your job's logs while the job is running or after it is finished in the Data Processing page in the manager
Last updated 14th November, 2020
This guide will help you to check your job's logs while your job is running or after your job is finished.
In this guide, we are assuming that you're using the OVHcloud Manager to use the Data Processing platform.
To read an introduction about Data Processing service you can visit Data Processing Overview.
You can see your live job's logs while it is running in the job dashboard. After your job is finished, you can download the logs either from your job dashboard or from your Object Storage directly.
Follow these steps to download your job's logs from your job dashboard:
Public Cloud
.Data Processing
from the left panel. Logs
tab in your job dashboard page. When streaming logs you are limited to 10 000 character at a time. Meaning you could experience missing logs in streaming mode. All logs will be uploaded to your Object Storage at job end.
Download logs
to download the output logs of your job from your Object Storage account. When your job is finished, the output log is automatically saved in your Object Storage and you can download it whenever you would like.
When the job is finished, the output logs will be saved automatically in your Object Storage account and in the odp-logs container. Beside using the job dashboard from the Data Processing page of the OVHcloud Manager, you can also use the Object Storage directly to download the logs. To download your logs from the Object Storage, follow these steps:
Public Cloud
Object Storage
from the left panel and then you will see the list of all containers in your project. odp-logs
odp-<Engine>-logs-<JobID>.log
...
at the end of the line to open the context menu. Download
To learn more about using Data Processing and how to create cluster and process your data, we invite you to look at Data Processing documentations page.
You can send your questions, suggestions or feedbacks in our community of users on https://community.ovh.com/en/ or in our public Gitter
Please feel free to give any suggestions in order to improve this documentation.
Whether your feedback is about images, content, or structure, please share it, so that we can improve it together.
Your support requests will not be processed via this form. To do this, please use the "Create a ticket" form.
Thank you. Your feedback has been received.
Access your community space. Ask questions, search for information, post content, and interact with other OVHcloud Community members.
Discuss with the OVHcloud community