Geek asks and answers

Insert 15 million rows into a DB2 database

I need to load about 15 million rows of data in a database DB2using java.

To keep things simple, I will not talk about the file format or the number of tables in the database. Let's say this is only one table with 5 columns that gets data from a huge single csv file.

In this scenario - I need something

  • Fast
  • Stable

I'm really not worried about

  • Code reuse
  • Modularity
  • Testing

It seems like a way to download a package using simple javais the way to go. I know Spring Batch, but I do n’t know whether to add this layer.

Question to the group - what would you suggest. Everything in the world Java / Java EEis an acceptable solution (if it does not require the software that we need to buy).

+5
source share
2 answers

Using ETLs such as Pentaho or Talend will be great.

0
source

Use the download tool to get it into the new table that you create.
Look at the log files to make sure there are no download errors.
Use JDBC or a stored procedure to manage data.
Backing up the destination table.
Use the simple insert statement to add data to the target table.

0
source

More articles:


All Articles