Brad Fitzpatrick (bradfitz) wrote in lj_backend,
Brad Fitzpatrick
bradfitz
lj_backend

Fun stuff lately in server land...

Presentation I did at MySQL conference in Orlando:

http://www.danga.com/words/2004_mysqlcon/

Building a distributed filesystem for Fotobilder/LiveJournal (will be open source):

http://www.livejournal.com/~brad/2009886.html
http://www.livejournal.com/~brad/2010534.html
http://www.livejournal.com/~brad/2010997.html

We just bought 2 machines with 16 250GB disks, so we'll soon have 8TB of storage. I imagine we'll get about 6TB of real storage out of that after redundancy. (thumbnails and scaled versions will only be on disk once, probably, since they can be recreated easily....)

Building a new load balancer for FotoBilder/LiveJournal, with special support for mixing efficient buffer of mod_perl requests and for efficiently serving large files (using sendfile(2)) from disk, so mod_perl doesn't have to do it:

http://www.livejournal.com/~brad/2007943.html

The proxy works already w/ FotoBilder. Haven't put it into production yet, but we rebooted all our LiveJournal proxies into Debian testing w/ epoll.h headers so we could build IO::Epoll (which is a requirement for Perlbal). They were already running Linux 2.6 (for epoll)
  • Post a new comment

    Error

    Comments allowed for members only

    Anonymous comments are disabled in this journal

    default userpic

    Your IP address will be recorded 

  • 8 comments