Conversation:

Notices

1. kat (boneidol)'s status on Sunday, 04-Feb-2018 07:51:54 EST kat

   Remote profile options...
   I've been trying to copy a single 4TiB ZFS dataset between 2 machines for > 1week now. 
   On dedicated 1Gb/s network with jumbo frames it takes ~ 20 hours over SSH ... however SSH keeps dying after ~ 12 hours with "Broken Pipe" :-(
   1. kat (boneidol)'s status on Sunday, 04-Feb-2018 08:00:43 EST kat

      Remote profile options...
      `zfs send tank/foo@then | ssh user@backup zfs recv tank/foo` fails
      `zfs send tank/foo@then > foo.zfs; scp zoo.zfs user@backup:/tank/` fails
      1. kat (boneidol)'s status on Sunday, 04-Feb-2018 08:04:39 EST kat

         Remote profile options...
         Anyway, I had enough space on the local box to dump the stream to file; and have copied it remote using netcat
         `zfs send tank/foo@then > foo.zfs` 
         `cat foo.zfs  | nc backup 9000`
         1. kat (boneidol)'s status on Sunday, 04-Feb-2018 08:05:12 EST kat

            Remote profile options...
            Now to see if the stream will import at the other end.
            1. kat (boneidol)'s status on Sunday, 04-Feb-2018 08:08:28 EST kat

               Remote profile options...
               I guess 4TiB will not seem like very much data to some people. But it's like 3,000,000 floppy disks, and it's a single file. - remember how much of a chore copying floppy disks was ?  In 20 years, it'll be like "OMFG remember when you thought copying 4TiB was hard,  lol"
               1. kat (boneidol)'s status on Sunday, 04-Feb-2018 08:13:06 EST kat

                  Remote profile options...
                  https://indy.im/attachment/1110 4TiB data copying
            2. kat (boneidol)'s status on Monday, 05-Feb-2018 14:03:22 EST kat

               Remote profile options...
               It's imported!  woot... 
               now can send incremental snapshots; just the daily diffs.  Life gets easier!