How do I split one file into two files using Python? [closed]

Answer 1

with open('data.txt') as inf, open('out1.txt','w') as of1, open('out2.txt','w') as of2:
    outf = of1
    for line in inf:
        if 'string pattern' in line:
            outf = of2
            continue  # prevent output of the line with "string pattern" 
        outf.write(line)

will work with large files since it works line by line. Assumes string pattern occurs only once in the input file. I like the str.partition() approach best if the whole file can fit into memory (which may not be a problem)

Using with ensures the files are automatically closed when you are done, or an exception is encountered.

Answer 2

No more than three lines:

with open('infile') as fp, open('of1','w') as of1, open('of2','w') as of2:
    of1.writelines(iter(fp.readline, sentinel))
    of2.writelines(fp)

Answer 3

You need something like:

def test_pattern(x):
    if x.startswith('abc'): # replace this with some exact test
        return True
    return False

found = False
out = open('outfile1', 'w')
for line in open('inputfile'):
    if not found and test_pattern(line):
        found = True
        out.close()
        out = open('outfile2', 'w')
    out.write(line)
out.close()

replace the line with startswith with a test that works on your pattern (using pattern matching from re if necessary, but anything that finds the devider line will do).

Answer 4

This approach is similar to Lev's but uses itertools because it's fun.

 dont_break = lambda l: l.strip() != 'string_pattern'

 with open('input') as source:
     with open('out_1', 'w') as out1:
         out1.writelines(itertools.takewhile(dont_break, source))
     with open('out_2', 'w') as out2:
         out2.writelines(source)

You could replace the dont_break function with a regular expression or anything else if necessary.

Answer 5

If the input file fits into memory, the easiest solution is to use str.partition():

with open("inputfile") as f:
    contents1, sentinel, contents2 = f.read().partition("Sentinel text\n")
with open("outputfile1", "w") as f:
    f.write(contents1)
with open("outputfile2", "w") as f:
    f.write(contents2)

This assumes that you know the exact text of the line separating the two parts.

Answer 6

A more efficient answer which will handle large files and consume a limited amount of memory..

inp = open('inputfile')
out = open('outfile1', 'w')
for line in inp:
  if line == "Sentinel text\n":
    out.close()
    out = open('outfile2', 'w')
  else:
    out.write(line)
out.close()
inp.close()