OVH Guides

Checking a job's logs in the Data Processing manager's page

Find out how to get your job's logs while the job is running or after it is finished in the Data Processing page in the manager

Last updated 06th March, 2020

Objective

This guide will help you to check your job's logs while your job is running or after your job is finished.

In this guide, we are assuming that you're using the OVHcloud Manager to use the Data Processing platform.

To read an introduction about Data Processing service you can visit Data Processing Overview.

Requirements

  • Access to OVHcloud Manager
  • A job that has been already submitted to Data Processing

Instructions

You can see your live job's logs while it is running in the job dashboard. After your job is finished, you can download the logs either from your job dashboard or from your Object Storage directly.

Data Processing Engine

Download the logs from your job dashboard

Follow these steps to download your job's logs from your job dashboard:

  • Login to the OVHcloud Manager and select Public Cloud.
  • Select the project in which you submitted your job.
  • Select Data Processing from the left panel.
  • Click on the name of the job that you want to check the logs for, to open the job dashboard.
  • Click on the Logs tab in your job dashboard page.
  • If your job is still running, you will see its live logs in this tab.

logs real time

  • If your job is already finished, click on Download logs to download the output logs of your job from your Object Storage account.

logs finished

When your job is finished, the output log is automatically saved in your Object Storage and you can download it whenever you would like.

Download your job logs from Object Storage

When the job is finished, the output logs will be saved automatically in your Object Storage account and in the odp-logs container. Beside using the job dashboard from the Data Processing page of the OVHcloud Manager, you can also use the Object Storage directly to download the logs. To download your logs from the Object Storage, follow these steps:

  • Login to the OVHcloud Manager and select Public Cloud
  • Select the project in which you submitted your job.
  • Select Object Storage from the left panel and then you will see the list of all containers in your project.
  • Click on the container named odp-logs
  • Find the log file of your job. The file name is odp-<Engine>-logs-<JobID>.log
  • Click on ... at the end of the line to open the context menu.
  • Click on Download

Go further

To learn more about using Data Processing and how to create cluster and process your data, we invite you to look at Data Processing documentations page.

You can send your questions, suggestions or feedbacks in our community of users on https://community.ovh.com/en/ or in our public Gitter


These guides might also interest you...