bash - SQLITE3 Importing .csv Files with Different Number of Columns -


i have thousands of .csv files each row can contain either 18 or 23 columns. file contains rows 18 columns, , rows 23 columns.

i'm using bash script run loop , import each file sqlite3 database running:

sqlite3 options.db ".mode csv data" ".import '$f' data"

and database schema has 23 columns.

problem: when sqlite3 encounters row 18 columns, prints on terminal message saying expected 23 found 18 - filling rest null, , proceeds next row. rows saved, terminal has print message each row, , since there millions of rows, slows down importing process lot.

question: how can suppress warning message sqlite3? if cannot suppress it, how can avoid in first place?

thanks helping! :d


Comments

Post a Comment

Popular posts from this blog

angular - DownloadURL return null in below code -

when change file updated in firebase storage when try downloadurl show null. filechange(event: any) { const imagefolder: string = this.employee.id; const filelist: filelist = event.target.files; const file: file = filelist[0]; const storageref = firebase.storage().ref().child(`${imagefolder}/profile.jpg`).put(file); console.log(storageref.snapshot.downloadurl); } the put() asynchronous. if want url after file uploaded have this: firebase.storage().ref().child(`${imagefolder}/profile.jpg`).put(file).then((snapshot) => { storageref = snapshot.downloadurl: console.log(snapshot.downloadurl); });
Read more

meteor - inserting data to database gives error "insert failed: Method '/texts/insert' not found" -

i have other project broke somehow(i have no idea) , rebuilt app same file names , code , working fine. problem when go insert data database called texts error insert failed: method '/texts/insert' not found not know wrong because copied every line of code previous project , problem came wasn't there before. confuses me when create user accounts accounts.createuser() works fine. sendtext.js import react "react"; import {texts} "./../api/text"; import {withrouter} 'react-router-dom'; import {meteor} "meteor/meteor"; import {accounts} "meteor/accounts-base" class sendtext extends react.component{ send(e){ e.preventdefault(); let message = this.refs.message.value; let name = accounts.user().username if(name != ""){ if(message){ texts.insert({ name, message }); this.refs.m...
Read more