I have a problem: I need to migrate 40TB of data from Oracle database (in .dmp format file) to my company database . The database contains only one table with two columns—one for the ID and the other for image data stored in BLOB format.
I am writing a script to automate the process of importing data from Oracle database into my company's database and then exporting the images in JPG format. However, due to the large volume of data, I am considering deploying my service on Kubernetes with multiple replicas to speed up the import and export process.
The problem is, I’m not sure if this approach is feasible, and if it is, I don’t know the best way to implement it.
Does anyone have any ideas or suggestions on how to handle this? I would really appreciate your help.