90,502 questions
0
votes
0
answers
28
views
Comparing two dates using SSIS conditional split component
CONTEXT
We retrieve data from a local Gas Station where the company's vehicles go to refuel their tanks in a CSV file.
So we save this data: VOLUME, TOTAL_AMOUNT($), PRODUCT (gas, premium, diesel), ...
2
votes
0
answers
44
views
Reading a 92 byte CSV file takes 15–20 seconds to process
I'm working on an Angular app and trying to read and parse a simple CSV file that is only 92 bytes.
Surprisingly, the upload and processing takes around 15 to 20 seconds, even for such a tiny file.
...
- 33
0
votes
0
answers
87
views
.csv -> .db taking WAY too long
My code (python) works, but at the rate it's running it'll take 72 hours to finish. I'm trying to turn a csv file into a database file in hopes that it'll be easier to use and access the data in it (...
- 11
-5
votes
0
answers
26
views
Guidance Request: Platform to Analyze Arduino Sensor Data (CSV) and Generate Dashboards + Maintenance Plans (Beginner in Programming) [closed]
I’m developing my graduation project and I could really use some advice. The project's main objective is to implement a predictive maintenance system for forklifts. The system uses an Arduino Mega and ...
-3
votes
1
answer
32
views
asp classic response.write csv file with text type for cells [duplicate]
I am using asp classic and try to response.write a csv file but for example when I try to print like this code:
Response.Write "000012"
Response.AddHeader "Content-Disposition", &...
- 321
1
vote
2
answers
69
views
Python Pandas.read_csv header and index column not lining up
I have a bunch of csv files read from a teensy adc onto an SD card and am trying to extract them to be able to do some basic stats over each row.
I have tried everything I can think of to try and fix ...
- 11
2
votes
2
answers
47
views
How can I delete a row from a csv file?
enter image description here
enter image description here
When I try to delete a row from my csv file, it deletes everything else and then turns that row sideways and separates the characters into ...
- 23
-1
votes
0
answers
56
views
Regardless, the double quotes are written to a CSV file in Python [duplicate]
My Python script reads data in JSON format, and then save data to the csv file (output.csv). Before it writes data to the csv file, it calls the function remove_double_quotes() to remove the double-...
- 21
3
votes
0
answers
200
views
read_csv only reads a fraction of rows from a zipped file when reading from URL
I'm trying to read a zipped CSV file from the National Oceanic and Atmospheric Administration (NOAA) web server. The file currently has 429,498 rows (it will have more tomorrow).
When I download the ...
- 1,803
1
vote
1
answer
28
views
Loading blank values into AWS Redshift
I am trying to load blank values as blank and null values as null from a CSV using COPY command in Redshift. But I see that when I use Data Conversion Parameters like EMPTYASNULL it loads both blanks ...
- 51
-1
votes
0
answers
25
views
How to dynamically convert XML to CSV using Jackson (with nested or dynamic structure)
Sure! To satisfy Stack Overflow's guidelines and avoid your entire post being mistaken for code, you'll want to add non-code descriptions above or between your code blocks. Here's a cleaned-up version ...
2
votes
2
answers
155
views
How to efficiently process a large CSV file with pandas when memory is limited?
I'm working with a very large CSV file (around 10GB) that doesn't fit into my computer's memory. When I try to load it into a pandas DataFrame using pd.read_csv(), I get a MemoryError.
What's the most ...
- 96
2
votes
1
answer
61
views
How to correct a ParserError when respecting the CSV delimiter and a second ParserError on URL string not expected with the delimiter defined?
I'm new here so I hope that I will put all needed information
As the CSV is a huge one (10Go), the URL link is in the code below if needed
URL link to the data description (column type...)
Delimiter ...
- 21
-4
votes
2
answers
79
views
CSV File Data limit [closed]
I have always wondered if there is a limit to the amount of data that i can store within a CSV file? I have set up my MVP to store data within a CSV file and currently the project grew to a very large ...
-3
votes
0
answers
48
views
How can I deserialize csv data in Java where rows have different schemas [closed]
I have a data set where one of the columns is a code that determines the schema for that row. It's something like this, but with many more columns:
A,123,abc
B,def,hij,klm
I'm using jackson-...
- 1,757