/7.1/aws/snippets/Recent content in AWS Snippets on Kinetica DocsHugo -- gohugo.ioen/7.1/aws/snippets/export-data/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/export-data/EXPORT ... INTO Sources (Table/Query) Data Sinks (File/Table/DML) Delimited Text Options Parquet Files Naming Options Sizing Options EXPORT ... INTO Sources (Table/Query) Table Query Table 1 2 EXPORT TABLE employee INTO FILE PATH '/export/employee.csv' Query 1 2 3 4 5 6 7 EXPORT QUERY ( SELECT id, manager_id, first_name, last_name, salary, hire_date FROM employee WHERE dept_id = 2 ) INTO FILE PATH '/export/employee_dept2.csv' Data Sinks (File/Table/DML) File Table (via JDBC) DML (via JDBC) Init Options (via JDBC) File 1 2 3 EXPORT TABLE employee INTO FILE PATH '/data/employee./7.1/aws/snippets/geohash/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/geohash/Enrich a Point-Based Table with Geohashes Create an Aggregated View with WKT Geometries Enrich a Point-Based Table with Geohashes Create a geohash for pickup locations in the NYC taxi data set. Lat/Lon-Based Table WKT-Based Table Lat/Lon-Based Table 1 2 3 4 5 6 7 8 CREATE OR REPLACE TABLE example_geospatial.nyctaxi_geohash AS ( SELECT pickup_latitude, pickup_longitude, STXY_GEOHASH(pickup_longitude, pickup_latitude, 6) AS geohash FROM example_geospatial.nyctaxi_xy ) WKT-Based Table 1 2 3 4 5 6 7 CREATE OR REPLACE TABLE example_geospatial./7.1/aws/snippets/geohash-h3/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/geohash-h3/Enrich a Point-Based Table with H3 Indexes Create an Aggregated View with WKT Geometries Enrich a Point-Based Table with H3 Indexes Create an H3 index for pickup locations in the NYC taxi data set. Lat/Lon-Based Table WKT-Based Table Lat/Lon-Based Table 1 2 3 4 5 6 7 8 CREATE OR REPLACE TABLE example_geospatial.nyctaxi_h3 AS ( SELECT pickup_latitude, pickup_longitude, H3_XYTOCELL(pickup_longitude, pickup_latitude, 8) AS h3_index FROM example_geospatial.nyctaxi_xy ) WKT-Based Table 1 2 3 4 5 6 7 CREATE OR REPLACE TABLE example_geospatial./7.1/aws/snippets/json-egress/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/json-egress/Simple Egress Egress with Parameters Egress with Aggregation The /get/records/json REST endpoint can be called to retrieve data in JSON form directly from the database. See Overview for call details and Responses for return values. Simple Egress cURL Python Java JavaScript Node.js cURL 1 2 3 4 5 6 7 8 9 10 KINETICA_URL=https://abcdefg.cloud.kinetica.com/hijklmn/gpudb-0 USERNAME=auser PASSWORD=apassword TABLE_NAME=product # Quote the URL when passing multiple options, or any & will stop the URL # parsing and run the URL parsed up to that point as a background job curl -sS ${KINETICA_URL}/get/records/json?/7.1/aws/snippets/json-ingest/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/json-ingest/Basic Ingest from File Ingest from File with Options Ingest from JSON String The /insert/records/json REST endpoint can be called directly, or with a convenient wrapper in the Java API. See Overview for call details and Responses for return values. Basic Ingest from File cURL Python Java Java (Distributed Ingest) JavaScript Node.js cURL 1 2 3 4 5 6 7 8 9 10 KINETICA_URL=https://abcdefg.cloud.kinetica.com/hijklmn/gpudb-0 USERNAME=auser PASSWORD=apassword TABLE_NAME=product JSON_FILE_NAME=products.json curl -sS -X POST --header "Content-Type: application/json" \ --user "${USERNAME}:${PASSWORD}" \ -d @${JSON_FILE_NAME} \ ${KINETICA_URL}/insert/records/json?/7.1/aws/snippets/load-data/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/load-data/LOAD INTO Single & Multiple KiFS Files Data Sources File/Queue-Based Query-Based File Types Delimited Text Files JSON/GeoJSON Files Parquet Files Shapefiles Avro Files Primary/Shard Keys Query Partitioning Options Other Options External Tables LOAD INTO Single & Multiple KiFS Files Single File Multiple Files by List Single File 1 2 LOAD DATA INTO example.product FROM FILE PATHS 'kifs://data/products.csv' Multiple Files by List 1 2 LOAD DATA INTO example.product FROM FILE PATHS 'kifs://data/products./7.1/aws/snippets/create-credentials/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/create-credentials/Azure GCS HDFS JDBC Kafka (Apache) Kafka (Confluent) S3 (Amazon) Several authentication schemes across multiple providers are supported. For a detailed overview of all of the provider-specific options, see the SQL documentation. Azure Password SAS Token Active Directory Password 1 2 3 4 CREATE CREDENTIAL azure_cred TYPE = 'azure_storage_key', IDENTITY = 'sampleacc', SECRET = 'foobaz123' SAS Token 1 2 3 4 CREATE CREDENTIAL azure_cred TYPE = 'azure_sas', IDENTITY = 'sampleacc', SECRET = 'sv=2015-07-08&sr=b&sig=39Up0JzHkxhUlhFEjEH9673DJxe7w6./7.1/aws/snippets/create-data-sinks/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/create-data-sinks/Amazon S3 Azure BLOB CData Google Cloud Storage HDFS JDBC Apache Kafka Web Hook Several authentication schemes across multiple providers are supported. For a detailed overview of all of the provider-specific options, see the SQL documentation. Note Creating an authenticated data sink requires creating a corresponding credential object to store the authentication information and then referencing that object when creating the data sink. See Create Credentials for examples. Amazon S3 Credential 1 2 3 4 5 6 7 8 CREATE DATA SINK s3_dsink LOCATION = 'S3' WITH OPTIONS ( CREDENTIAL = 's3_cred', BUCKET NAME = 'samplebucket', REGION = 'us-east-2' ) Azure BLOB Credential 1 2 3 4 5 6 7 CREATE DATA SINK azure_dsink LOCATION = 'AZURE' WITH OPTIONS ( CREDENTIAL = 'azure_cred', CONTAINER NAME = 'samplecontainer' ) CData Credential Password in URL Credential 1 2 3 CREATE DATA SINK cdata_dsink LOCATION = 'jdbc:postgresql:Server=localhost;Port=5432;Database=ki_home' WITH OPTIONS (CREDENTIAL = 'cdata_cred') Password in URL 1 2 CREATE DATA SINK cdata_dsink LOCATION = 'jdbc:postgresql:Server=localhost;Port=5432;Database=ki_home;User=dsink_user;Password=dsink_pass' Google Cloud Storage Credential 1 2 3 4 5 6 7 CREATE DATA SINK gcs_dsink LOCATION = 'GCS' WITH OPTIONS ( CREDENTIAL = 'gcs_cred', GCS_BUCKET_NAME = 'gcs-private' ) HDFS Credential 1 2 3 CREATE DATA SINK hdfs_dsink LOCATION = 'HDFS://example./7.1/aws/snippets/create-data-sources/Mon, 01 Jan 0001 00:00:00 +0000/7.1/aws/snippets/create-data-sources/Azure BLOB CData Google Cloud Storage HDFS JDBC Kafka (Apache) Kafka (Confluent) S3 (Amazon) Several authentication schemes across multiple providers are supported. For a detailed overview of all of the provider-specific options, see the SQL documentation. Azure BLOB Credential Public (No Auth) Password SAS Token Active Directory Credential 1 2 3 4 5 6 7 CREATE DATA SOURCE azure_ds LOCATION = 'AZURE' WITH OPTIONS ( CREDENTIAL = 'azure_cred', CONTAINER NAME = 'samplecontainer' ) Public (No Auth) 1 2 3 4 5 6 7 CREATE DATA SOURCE azure_ds LOCATION = 'AZURE' USER = 'sampleacc' WITH OPTIONS ( CONTAINER NAME = 'samplecontainer' ) Password 1 2 3 4 5 6 7 8 CREATE DATA SOURCE azure_ds LOCATION = 'AZURE' USER = 'sampleacc' PASSWORD = 'foobaz123' WITH OPTIONS ( CONTAINER NAME = 'samplecontainer' ) SAS Token 1 2 3 4 5 6 7 8 CREATE DATA SOURCE azure_ds LOCATION = 'AZURE' USER = 'sampleacc' WITH OPTIONS ( CONTAINER NAME = 'samplecontainer', SAS TOKEN = 'sv=2015-07-08&sr=b&sig=39Up0JzHkxhUlhFEjEH9673DJxe7w6clRCg0V6lCgSo%3D&se=2016-10-18T21%A51%A337Z&sp=rcw' ) Active Directory 1 2 3 4 5 6 7 8 9 10 CREATE DATA SOURCE azure_ds LOCATION = 'AZURE' USER = 'jdoe' PASSWORD = 'foobaz123' WITH OPTIONS ( STORAGE ACCOUNT NAME = 'sampelacc', CONTAINER NAME = 'samplecontainer', TENANT ID = 'x0xxx10-00x0-0x01-0xxx-x0x0x01xx100' ) CData Credential Password in URL Password as Parameter Credential 1 2 3 CREATE DATA SOURCE cdata_ds LOCATION = 'jdbc:postgresql:Server=my.