CSV, Excel ,JSON configuration
Overview
SDI can import from and export to CSV , Excel or JSON files.
When using a CSV , Excel or JSON file, select file as the location , select CSV , Excel or JSON as the data type, and configure the detailed settings.
File systems, FTP/FTPS, SFTP, AWS S3, OCI Object Storage are supported.
Configuration
File system
| No | Item | Description |
|---|---|---|
| 1 | Storage Type | Select File System |
| 2 | File Directory | Select CSV file save folder |
FTP/FTPS
| No | Item | Description |
|---|---|---|
| 1 | Storage Type | Select FTP/FTPS |
| 2 | User ID | FTP login User ID |
| 3 | Password | FTP login password |
| 4 | FTP Host | |
| 5 | FTP Port | |
| 6 | Folder | FTP Folder |
SFTP
| No | Item | Description |
|---|---|---|
| 1 | Storage Type | Select SFTP |
| 2 | User ID | SFTP login User ID |
| 3 | Private key | If the SFTP server uses key authentication, check Private key and then specifies the private key file. |
| 4 | Key PassPhrase | If a passphrase is set for the private key file, enter the passphrase. If no passphrase is set, leave it blank. |
| 5 | Password | If the SFTP server uses password authentication, check Password before entering the SFTP user password. |
| 6 | SFTP Host | |
| 7 | SFTP Port | |
| 8 | Folder | SFTP Folder |
AWS S3
Please note when creating AWS Credentials File
Normally, the OS user performing ODI Studio and the OS user executing worker agents are different. Save your AWS Credentials file to a folder that can be accessed by both OS users.
If you use the default configuration file location from the official documentation, the worker agent may not be accessible.
Reference：Named profiles for the AWS CLI
AWS Credentials File example：
[default]
aws_access_key_id=AKIAIOSFODNN7EXAMPLE
aws_secret_access_key=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
region=ap-northeast-1
[user1]
aws_access_key_id=AKIAI44QH8DHBEXAMPLE
aws_secret_access_key=je7MtGbClwBF/2Zp9Utk/h3yCo8nvbEXAMPLEKEY
region=ap-northeast-1
| No | Item | Description |
|---|---|---|
| 1 | Storage Type | Select AWS S3 |
| 2 | Credentials File | Specifies the AWS Credentials File |
| 3 | Profile | Profile name in AWS Credentials File. * Case sensitive |
| 4 | BucketName | S3 BucketName |
| 5 | Folder | S3 Folder name. * Leave blank to use the root directory. |
OCI Object Storage
Please note when creating OCI Configuration File
Normally, the OS user performing ODI Studio and the OS user executing worker agents are different. Save your OCI Configuration File to a folder that can be accessed by both OS users.
If you use the default configuration file location from the official documentation, the worker agent may not be accessible.
Reference：SDK and CLI Configuration File
OCI Configuration File Example：
[default]
user=ocid1.user.oc1..aaaaaaaamaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
fingerprint=a8:63:a7:a2:89:a9:a3:98:a0:aa:a4:20:a7:ab:0a:0a
tenancy=ocid1.tenancy.oc1..aaaaaaaamaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
region=ap-tokyo-1
key_file=C:\keys\oci\test_1.pem
[user1]
user=ocid1.user.oc1..bbbbbbbbmbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb
fingerprint=b8:63:b7:b2:89:b9:b3:98:b0:bb:b4:20:b7:bb:0b:0b
tenancy=ocid1.tenancy.oc1..aaaaaaaamaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
region=ap-tokyo-1
key_file=C:\keys\oci\test_2.pem
| No | Item | Description |
|---|---|---|
| 1 | Storage Type | Select OCI Object Storage. |
| 2 | Configuration File | Specifies the OCI Configuration File. |
| 3 | Profile | Profile name in OCI Configuration File. * Case sensitive. |
| 4 | Namespace | OCI Object storage Namespace Name |
| 5 | BucketName | OCI Object storage BucketName |
| 6 | Folder | OCI Object storage Folder name. * Leave blank to use the root directory. |