on 02-08-2021 8:06 PM
Hi community.
I am exploring sap hana cloud the data lake part. and what i want to know is,
is it possible to load data from csv file to table created in datalake in SYSRDL # CG schema?
I have seen tutorials on how to load data in datalake but from amazon s3 or azure, but it is not what I need at the moment.best regard.
Yes, you can. Quite easily so long as you have cloud storage with AWS (s3) or Azure (ADLS/ADLS2). If your file is not in AWS or Azure, then you will need to import the data to HANA then copy it into the data lake.
What is it that you need at the moment? How do you want to load the data?
To make it work with cloud storage, you need is an AWS or Azure storage location. I think they both offer free, small areas, for you to test.
Once you have that, you can generate a secure key (s3) or connection string (ADLS) and use that as part of the LOAD TABLE statement.
I think most of the data lake manuals have details on how to do this by using the REMOTE_EXECUTE HANA function and passing it the LOAD TABLE syntax.
AWS: Loading Data from the Amazon S3 Bucket
Azure: Loading Data from Azure Blob Storage
If you go to the "Batch Load..." sub section it has full examples, too.
Lastly, check out the SAP Roadmap. We are adding a "SQL on File" and other cloud storage related features in the Q1 release at the end of March.
Data Lake: Data Lake Roadmap
Files: File Related Items
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Eisson,
If you have already created a table in HANA Cloud and loaded the data into that table from file then you can directly load the data using insert statement. First, create a virtual table on top of datalake table and then use that virtual table to perform any actions for example in your case is insert. it will look something like this "insert into <virtual_table> (select * from <hana_cloud_table>)"
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
User | Count |
---|---|
86 | |
11 | |
8 | |
7 | |
7 | |
6 | |
6 | |
6 | |
6 | |
6 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.