Last updated 14th November, 2020
Objective
This guide will help you to check your job's logs while your job is running or after your job is finished.
In this guide, we are assuming that you're using the OVHcloud Manager to use the Data Processing platform.
To read an introduction about Data Processing service you can visit Data Processing Overview.
Requirements
- Access to OVHcloud Manager
- A job that has been already submitted to Data Processing
Instructions
You can see your live job's logs while it is running in the job dashboard. After your job is finished, you can download the logs either from your job dashboard or from your Object Storage directly.
Download the logs from your job dashboard
Follow these steps to download your job's logs from your job dashboard:
- Login to the OVHcloud Manager and select
Public Cloud. - Select the project in which you submitted your job.
- Select
Data Processingfrom the left panel. - Click on the name of the job that you want to check the logs for, to open the job dashboard.
- Click on the
Logstab in your job dashboard page. - If your job is still running, you will see its live logs in this tab.
When streaming logs you are limited to 10 000 character at a time. Meaning you could experience missing logs in streaming mode. All logs will be uploaded to your Object Storage at job end.
- If your job is already finished, click on
Download logsto download the output logs of your job from your Object Storage account.
When your job is finished, the output log is automatically saved in your Object Storage and you can download it whenever you would like.
Download your job logs from Object Storage
When the job is finished, the output logs will be saved automatically in your Object Storage account and in the odp-logs container. Beside using the job dashboard from the Data Processing page of the OVHcloud Manager, you can also use the Object Storage directly to download the logs. To download your logs from the Object Storage, follow these steps:
- Login to the OVHcloud Manager and select
Public Cloud - Select the project in which you submitted your job.
- Select
Object Storagefrom the left panel and then you will see the list of all containers in your project. - Click on the container named
odp-logs - Find the log file of your job. The file name is
odp-<Engine>-logs-<JobID>.log - Click on
...at the end of the line to open the context menu. - Click on
Download
Go further
To learn more about using Data Processing and how to create cluster and process your data, we invite you to look at Data Processing documentations page.
You can send your questions, suggestions or feedbacks in our community of users on https://community.ovh.com/en/ or in our public Gitter