title tells the main problem:
I want to read from a SQLite database file, but i always get the error message "database disk image is malformed".
Exception in component tDBInput_5 (ImportContent) java.sql.SQLException: database disk image is malformed at org.sqlite.DB.execute(DB.java:275) at org.sqlite.Stmt.exec(Stmt.java:56) at org.sqlite.Stmt.executeQuery(Stmt.java:90) at local_project.importcontent_0_1.ImportContent.tDBInput_5Process(ImportContent.java:1507) at local_project.importcontent_0_1.ImportContent.tDBConnection_5Process(ImportContent.java:471) at local_project.importcontent_0_1.ImportContent.runJobInTOS(ImportContent.java:2420) at local_project.importcontent_0_1.ImportContent.main(ImportContent.java:2269) [statistics] disconnected
I tried multiple versions of a job:
tDBConnection(SQLite) --onSubjobOk--> tDBInput --row1--> tMap -> etc.
tDBInput(SQLite) --row1--> tMap -> etc. (with DB Connection from Metadata)
When i create the metadata, i can test connect to the db-file without problems. I can also read the table schemata from database file without problems.
I can open the database file with DB Browser for SQLite without problems.
I can query the table (it is just one) just fine via DB Browser or Terminal.
Running "pragma integrity_check" runs just fine without any problems ("ok")
The database file is very big (>4 GB)
The database file has an .sql ending ( i also tried renaming the file to .db, no change)
The database file was created by an external source.
I use Talend Open Studio For Data Integration 7.0.1 and Java Version 8 Update 191
Did anyone run into the same problem?
Regards in advance from Germany
What's SQLite database version are you using and what's your Input query?
the sqlite version used to create the database file is 2.6.0.
The Query is autogenerated by drag & drop the schema to the job. i kept that because i needed all columns & all rows
"SELECT CONTENT.SkriptID, CONTENT.ZeilenID, CONTENT._order, CONTENT.url, CONTENT.snippet, CONTENT.title, CONTENT._Case, CONTENT.Content, CONTENT.Search_Term FROM CONTENT"
As described, generating the meta-data & schma works without problems.
Is that of any help?
Introduction to Talend Open Studio for Data Integration.
Practical steps to developing your data integration strategy.
Create systems and workflow to manage clean data ingestion and data transformation.