Questions tagged [split]
The split tag has no summary.
283 questions
3
votes
3
answers
1k
views
How do I extract some pages of a PDF into another PDF file?
I have a PDF file with multiple pages, and I want to write a command which extracts some of these pages into a new, separate PDF file; and the pages of interest are not necessarily a contiguous range.
...
- 11.1k
-1
votes
2
answers
83
views
Split string with 0-2 / (or determine there's none) (Bash)
Update: Up to 2 "/" in the string.
String structure is either:
Character set name/LF
Character set name/CRLF
Character set name/CRLF/(unknown purpose, likely a number)
Character set name
...
- 113
0
votes
1
answer
106
views
Slow down a `split`
I have a really large archive consisting of really small files, concatenated into a
single text file, with a "" dilimiter. For smaller archives, I would split
the archive using "" ...
- 1,240
2
votes
1
answer
180
views
Is it safe to slicing byte directly to split a big file?
In my case, the big file is tar.gz, I have myBigFile.tar.gz with size 52GB, I splitted it with chunk size 2GB therefore I have 27 parts file.
Here is the code I program from scratch:
from time import ...
2
votes
1
answer
195
views
Merge the split file vs Original compressed file
On Ubuntu 22.04,
I found these 2 methods will get different sha256 of archive_tgz
tar czf /a/archive_tgz .
tar czf /dev/stdout . | split -d -b 200M - /a/archive. && cat /a/archive.* > /a/...
- 43
1
vote
3
answers
748
views
Split large file in realtime whilst it is still being written to
I've got a program that will be generating 4 large binary files (400GB+ each) that I need to upload to AWS S3 as quickly as possible.
I'd like to begin uploading before the files are completely ...
0
votes
2
answers
357
views
Linux - split a big file into small files according to specific character and how many it repeats
I have a really big file that looks like this:
>name1
ACGTACGTACGT
ACGTACGTACGT
ACGTACGTACGT
ACGTACGTACGT
>name2
ACGTACGTACGT
ACGTACGTACGT
ACGTACGTACGT
>name
ACGTACGTACGT
ACGTACGTACGT
...
- 3
1
vote
2
answers
223
views
Divide a fasta file with scaffolds into same lenght files respecting the scaffold ID and the sequence
I am currently working with a large fasta file (3.7GB) that has scaffolds in it. Each scaffold has a unique identifier that starts with > on the first line and on the consecutive line it has the ...
- 13
0
votes
0
answers
82
views
How to store multiple files in an array
I am using the split command in cshell to split a file into smaller files. Since the split command names the output files xaa,xab,xac.... i have to rename them. I want to store the split commands ...
9
votes
2
answers
1k
views
Split two concatenated files
I have Afile made by the equivalent of cat a.gif b.7z > Afile.
How may I split Afile into the original a.gif and b.7z files?
- 105
1
vote
0
answers
1k
views
Split serial port into two virtual ports
This question is related to this post here:
Cloning/Splitting a serial port (COM) port in Ubuntu
I followed the steps to make the virtual ports but the problem is that I need full-duplex ...
- 111
0
votes
1
answer
199
views
How to archive and compress large dataset into parts efficiently?
Currently using following model, but one needs double the amount of disk space to restore compressed archive given one has to pipe all parts to tar before one can delete them.
$ COPYFILE_DISABLE=true ...
- 327
16
votes
1
answer
3k
views
Splitting a small file into 512 byte segments changes it, but splitting it in 1k segments doesn't
So I'm trying to split a 64MB file FileCarve.001 into 512 byte segments (each block is 512 bytes long). I need to make sure the file has the same data when split into smaller files, so I cat all the ...
- 171
8
votes
1
answer
2k
views
Split ultrawide monitor in 3 virtuals screens
For my work, I try to split my new ultrawide monitor in 3 virtual screens on Ubuntu (I don't want to use tile tools as gTile).
My first test using "xrandr" was OK when I selected "xorg&...
- 81
3
votes
3
answers
2k
views
I don't really understand expansion and quoting on the shell (zsh/bash)
I've read up on a few answers here in reference to quoting variables on the shell.
Basically, here's what I'm running:
for f in "$(tmsu files)"; do echo "${f}"; done
this has the ...
- 2,602
1
vote
1
answer
152
views
Is it with GNU parallel possible to split on character count, but provide full lines only?
I would like to split an input file on character count (ASCII is fine), combined with new lines as well. That is, every group of 10000 character should be seen as one record to be piped into the child ...
2
votes
2
answers
3k
views
Automating the splitting of a large mp3 file with FFmpeg into multiple files in different time points provided in a text file
I have a large mp3 file; I want to split it into 480 mp3 files in different time points. I want to know if there is an easy way to do it other than splitting it one by one. Can I provide the different ...
- 23
1
vote
1
answer
10k
views
Using split() with awk
I am trying to use split() with awk. I am splitting the contents of $7 with split() into an array, but not sure how to print the contents starting from reverse order. The field $7 is of variable ...
- 11
10
votes
1
answer
3k
views
Save current vim session state and restore it later (e.g. buffers, splits etc.)
As an old VIM user, attracted to it in the first place especially because of its straightforward regex substitutions that allow to work really fast, I'm not really expecting VIM to have such a feature....
- 203
0
votes
1
answer
474
views
how to get split commands output to file
I want to print output of below command to file, can you help me I tried 2>&1 even 2>> also
dd if=/dev/random bs=1 count=1000 status=progress |split -b 10 -a 10
I have other dd command ...
- 95
4
votes
2
answers
2k
views
How to split CSV file and create multiple CSV files based on a column
I have a csv file with the format:
Input.csv:
TIMESTAMP,Data1,Data2,Data3,Data4
"2021-01-03 00:00:00",80953,3.243183,2.943338,358.0123
"2021-01-03 00:01:00",80954,2.173187,1.990327,...
- 151
1
vote
0
answers
200
views
Can GNU tar run a filter before adding a file to an archive?
I am trying to archive a directory containing many subdirectories and files, most of which are JPEG files. I would like to run each file through JPEG XL before adding to the tar archive, to reduce ...
- 1,485
2
votes
1
answer
2k
views
Split large file into chunks and delete original?
I'm having trouble with a large text file (30GB)
I would like to create smaller files from it (5GB lets say)
But sadly I don't have no more storage (only ~10G is available).
This line:
split -b 5g &...
0
votes
0
answers
983
views
Split command to chunk a large CSV - with new line character
I'm splitting a large CSV file with small chunks using the split command. Each file should contain 1000 rows only.
The command I used is,
cat large.csv | split -a3 -l1000 --filter='gzip > $FILE.gz'...
- 405
4
votes
1
answer
987
views
Split large files into a number of files in unix
i have a file that contains several lines(9074 line), i want to split the file into 10 files contain the same number of lines except the last file that contain the remainder number of lines
split -l `...
- 41