Skip to main content
Version: 4.x

Apache Ozone

Starting from version 4.0.4, Doris supports accessing Apache Ozone through the S3 Gateway.

This document describes the parameters required to access Apache Ozone. These parameters apply to:

  • Catalog properties
  • Table Valued Function properties
  • Broker Load properties
  • Export properties
  • Outfile properties

To use Ozone as a dedicated storage type, configure "fs.ozone.support" = "true" explicitly.

Parameter Overview

Property NameLegacy NameDescriptionDefault ValueRequired
ozone.endpoints3.endpointOzone S3 Gateway endpoint, for example http://ozone-s3g:9878NoneYes
ozone.regions3.regionRegion of Ozone S3 Gatewayus-east-1No
ozone.access_keys3.access_key, s3.access-key-idAccess key used for authenticationNoneNo*
ozone.secret_keys3.secret_key, s3.secret-access-keySecret key used for authenticationNoneNo*
ozone.session_tokens3.session_token, s3.session-tokenSession tokenNoneNo
ozone.connection.maximums3.connection.maximumMaximum number of connections100No
ozone.connection.request.timeouts3.connection.request.timeoutRequest timeout in milliseconds10000No
ozone.connection.timeouts3.connection.timeoutConnection timeout in milliseconds10000No
ozone.use_path_styleuse_path_style, s3.path-style-accessWhether to use path-style accesstrueNo
ozone.force_parsing_by_standard_uriforce_parsing_by_standard_uriWhether to force standard URI parsingfalseNo
fs.ozone.supportWhether to enable Ozone as storage typefalseYes

Notes:

  • ozone.access_key and ozone.secret_key must be configured together.
  • fs.s3a.* keys are not parsed directly by Ozone properties. Use ozone.* or compatible s3.* keys.
  • Ozone supports s3://, s3a://, and s3n:// URI schemas.
  • Setting ozone.endpoint (or s3.endpoint) alone does not enable Ozone. You must set fs.ozone.support=true.

Example Configuration

Using ozone.* keys:

"fs.ozone.support" = "true",
"ozone.endpoint" = "http://ozone-s3g:9878",
"ozone.access_key" = "hadoop",
"ozone.secret_key" = "hadoop",
"ozone.region" = "us-east-1",
"ozone.use_path_style" = "true"

Using compatible s3.* aliases:

"fs.ozone.support" = "true",
"s3.endpoint" = "http://ozone-s3g:9878",
"s3.access_key" = "hadoop",
"s3.secret_key" = "hadoop",
"s3.region" = "us-east-1",
"s3.path-style-access" = "true"