Adding Internal Connections
Internal connections are added to an Execution Profile.
Steps
-
Open an Execution Profile and then click the Internal Connections tab.
-
In the List of Connections page, click the Add New Internal Connection button.
-
Specify a connection type (i.e., Database, File System, Application) and provide a connection name (required) and description (optional).
-
Provide further details according to the connection type you are creating.
-
MySQL
-
Oracle
-
PostgreSQL
-
Microsoft SQL Server
-
Host Name
-
Port
-
Database Name (refer here for a guide)
-
Credentials for Connections
-
Username
-
Password
-
HDFS
-
File System
-
Amazon S3
-
Endpoint
-
Credentials for Connections
-
Access Key
-
Secret Key
-
MLFlow Server URL
-
Endpoint
-
Credentials for Connections
-
Access Key
-
Secret Key
-
If the Oracle database you wish to connect to is exposed with service names instead of SID, the database name (schema.Table name) should be entered as "?service_name=dbName."
-
When adding databases with the versions and configurations specified below, the connection details should be provided.
-
You can create connections to Amazon S3 with or without a bucket.
-
Click Save when you are done.
The New Connection page displays.
Connection Type |
Connection Subtype |
Properties |
Database |
|
|
File System |
|
For Amazon S3: |
Application |
ML Flow |
|
NOTES
Database |
Apache Spark |
Pandas |
Oracle 12.2.03 (19c, 19.1) |
|
Enter Database Name as "?service_name=orclpdb" |
MySQL 8.0 |
Enter Database Name as "<dbname>?serverTimezone=UTC" |
|
When specifying tables from the above connections in the Import from Database node:
Database |
Pandas |
Apache Spark |
Oracle 12.2.03 (19c, 19.1) |
|
Enter Table Name as "<schema.Table name>" |
In the following example, the internal connection points to Amazon S3 without a specified bucket.
In this case, if you wish to import data from a specific bucket, you must specify the bucket in which your file resides in the Import Settings property of the Import Text node.
Alternatively, you can include a specific bucket when creating the connection.
In this case, if you wish to import data from a specific bucket, you directly provide the file location the Import Settings property of the Import Text node.
Your newly defined connection displays in the List of Connections page. All created internal connections are available for use with the Import Text/Import From Database nodes.