17,667 questions
0
votes
2
answers
31
views
What is the difference between an MPI nonblocking collective write, iwrite_all vs a "nonblocking" noncollective iwrite combined with a file sync?
I'm setting up IO for a largescale CFD code using the MPI library and the file IO is starting to eat into computation time as my problems scale.
As far as I can find the "done" thing in the ...
3
votes
0
answers
80
views
numpy.load() seems to use double the memory of the array at peak
I thought numpy.load() writes directly into the array data memory.
However, the results of the profiling functions (I profiled with memray and mprof) seems a bit strange to me...
My array is 2GB big. ...
- 476
0
votes
0
answers
19
views
Tfest for more Input-Output pairs in matlab
i have 14 pairs of input-output of a SISO system. I want to find the Transfer Function on the system, I'm using tfest() to estimate it, but I understand how to use it only for one data pair at time. I ...
-4
votes
2
answers
79
views
CSV File Data limit [closed]
I have always wondered if there is a limit to the amount of data that i can store within a CSV file? I have set up my MVP to store data within a CSV file and currently the project grew to a very large ...
2
votes
1
answer
104
views
Console.writer().println() vs Console.format() vs System.out.println()
Console.writer().println() is displaying "Enter 3 words" after console.readLine().
Can anyone explain why?
class Class3{
public static void main(String... args){
Console console =...
- 23
0
votes
0
answers
20
views
Why does the first command of my WDL task output its results to the input folder?
I have a WDL workflow that I use miniwdl to run.
The second task of my workflow outputs its first command's results to the input folder by default. I was able to work around this by including '-o .' ...
- 13
0
votes
1
answer
53
views
Reading Incorrect Data with C# (Custom PAK File)
I am trying to write my own game engine. I packaged the files such as assets of the games so that the engine can read them faster and easier. However, I encountered a problem. I could not find the ...
0
votes
0
answers
44
views
Why is data written to the file even though the buffer is not full when the program finishes? [duplicate]
I expected that without calling fclose(), and with the buffer not being full, nothing would be written to the file. But when the program finishes, the data still appears in the file.
Or the C runtime ...
- 39
1
vote
1
answer
82
views
What's the differences between io.TeeReader and io.MultiWriter?
I want to build an llm app and add a middleware to monitor token usage. The result I get from the llm provider is a sse stream. I googled and get two similar results, io.TeeReader and io.MultiWriter. ...
- 45
0
votes
1
answer
35
views
Why is stdout PIPE readline() not waiting for a newline character? [closed]
Why is print(line) in read_stdout printing every character instead of the entire line? I am expecting it to add to the queue once the newline character is reached, but it's just putting every ...
- 1,206
4
votes
2
answers
106
views
Why does read() in C read input in chunks when there's no user-level buffering?
I'm learning how the POSIX read() function works in C. I understand that read() is considered unbuffered, meaning it doesn't manage any internal buffer like fread() does. But I'm confused by the ...
- 39
0
votes
1
answer
39
views
Does DMA play a role in process loading (from disk to memory)?
I’m trying to understand how operating systems load a program into memory from a hardware perspective.
I know that DMA (Direct Memory Access) is used for I/O operations, allowing data transfer between ...
- 1
-1
votes
1
answer
69
views
Why does the C# compiler suggest using await for File.OpenRead() which does not return a task? [duplicate]
await using (var streamReader = File.OpenRead(filePath))
using (var reader = new StreamReader(streamReader))
{
while ((line = await reader.ReadLineAsync()) != null)
{
// my logic
}
}
...
- 333
0
votes
0
answers
42
views
How to write a string containing binary representation of data to file? [duplicate]
I am trying to write a binary string as binary data to file but my function seems to be having a problem with the int conversion. I am reading a text file and manipulating it which gives me a string ...
- 302
2
votes
1
answer
90
views
Deleting final line in a text file in C++
I have a program where a user can write (append) to a chosen text file for storing information. Each line should be two numbers, and a date string (YYYY-MM-DD). There a multiple different text files ...
- 149