Skip to content

Каталог файловой системы

Bases: IcebergCatalog, FrozenModel

Iceberg Filesystem Catalog (Hadoop Catalog).

Added in 0.15.0

Note

This catalog stores Iceberg tables as nested directories:

{warehouse.path}/{schema}/{table}
This means that tables cannot have a custom location and will always be created under the schema directory inside the warehouse path.

Examples

from onetl.connection import Iceberg

catalog = Iceberg.FilesystemCatalog()
Source code in onetl/connection/db_connection/iceberg/catalog/filesystem.py 
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
class IcebergFilesystemCatalog(IcebergCatalog, FrozenModel):
    """Iceberg Filesystem Catalog (Hadoop Catalog).

    !!! success "Added in 0.15.0"

    !!! note

        This catalog stores Iceberg tables as nested directories:

        ```text
        {warehouse.path}/{schema}/{table}
        ```
        This means that tables **cannot have a custom location** and will always be created
        under the schema directory inside the warehouse path.

    Examples
    --------

    ```python
    from onetl.connection import Iceberg

    catalog = Iceberg.FilesystemCatalog()
    ```
    """

    def get_config(self) -> dict[str, str]:
        return {
            "type": "hadoop",
        }