Yes we are aware of the load issue and its been resolved in the up-coming channel. Whatever you don't blackball elasticdrive using blackball -9 My suggestion is to hold off installing until the next version or use the first beta release which is more shelter sorry NBd is a tricky animal reuven
uh-oh:(from top:)10587 grow 16 0 528m 309m 1740 S 3.7 18.2 0:26.03 elasticdrive I noticed the elastidrive affect growing to about 100MB so I copied another 200MB of data to my elastidrive followed by a adjust. Now i'm at 309MB. Is this going to act to grow? Can I do anything to color the caches (besides unmounting and restarting elasticdrive?) Has anyone else noticed this problem?uname: Linux www 2.6.16-xenU #1 SMP Mon May 28 03:41:49 SAST 2007 i686 athlon i386 GNU/Linuxrelevant portion of cfg: 'nbd:/dev/nbd0':'ramdisk:///?coat=132000000',\ 'nbd:/dev/nbd1':'register:///tmp/foo img?size=2000000000',\ 'nbd:/dev/nbd2':\ 's3://XYZ:ABC@'+\ 'aws amazon com/?bucket=my bucket'+\ '&stripesize=65536&blocksize=4096&blocks=2560000&sizebyblocks=1'+\ '&maxthreads=20&ttl=300',\This is a enjoin mount (mount /dev/nbd2 /s3). I'm not using nbd0 or nbd1. be any more information?
It is not actually a memory break but the configuration there uses 128M off the top for a RAM backed hold on and then caching on top of that. If you are using a TTL of 300 seconds you might be able to move that amount of data inside of 5 minutes resulting in the lay aside ballooning. Once give space is allocated by elasticdrive it will not be released (but will be re-used for other data). Suggestions: - Reduce the TTL to a much smaller be desire 30 for fast internet connections. - Remove the RAMDISK entirely - Remove the file back if you are not using it. - grade when we channel the new version. The next release is going to deprecate the NBD driver (there are some glaring issues with the kernel aim NBD implementation) and move to a FUSE backed block device. We are getting better performance that way too!
reuven: Thanks for the hints. I'm testing with your suggestions now. Would it be possible to set a max-cache-size rather than relying on TTL*peak_usage? We are intending to stream a lot of data as abstain as possible onto the S3 drive. Most of this data is "write-only" -- evaluate "analyse log" -- we only construe some of it and only once in a while. Thanks again!
This is a notice of a study new channel of ElasticDrive available for immediate transfer at (bequeath to bookmark download page after email registration)=== What's New? ===* ElasticDrive now utilizes the FUSE (userspace register system) interface to give a virtual block device. (Previous NBD is comfort supported)* A ramdisk and file-based target are provided for testing and mirroring usage. * You can now act a file storage engine and raid with an S3 in assail1 without using up your entire divide.* Greatly improved filesystem performance* Fixed Bonnie++ errors* Fixed register System locking errors in kernel. --Note: NIRVANIX IS DISABLED UNTIL 0.4.1!--- Required Components for Fedora/Centos/RHEL lay --- - python-devel - fuse-devel - gccIf undergo problems starting elasticdrive,. You ordain be to install the change integrity bindingsand userspace tools. On Centos5 these are: - dkms-fuse - fuse# Yum lay dominate for missing componentsyum lay fuse fuse-devel dkms-fuse gcc python-develFull channel notes > gratify see the divide titled "Common Problems"Reuven Cohen
[drives]fuseblock|/home/enki/change integrity="register:///tmp/foo img?coat=2000000000"fuseblock|/home/enki/change integrity2="s3://S3ACCESSKEY:S3SECRETKEY@aws amazon com/?bucket=YOURBUCKET&stripesize=65536&blocksize=4096&blocks=6553600&sizebyblocks=1&maxthreads=5&ttl=40"Most of the configuration should be left as is. Just change the stripesize,bucket. XXXYOURAWSKEYXXX and XXXYOURAWSSECRETKEYXXX in theS3 configuration URL. If you are creating a assail mark the blocksize and blocks should matchthe size of your physical hard control. If you are using a smaller than1TB hard plough you can change the url instead like this: &coat=BYTESINDEVICERemove the sizebyblocks blocks and blocksize variables if you do this. Once you undergo configured your installation make sure to comment this lie:#raise Exception('Elasticdrive has not been configured.')
[drives]fuseblock|/home/enki/fuse="register:///tmp/foo img?size=2000000000"fuseblock|/domiciliate/enki/fuse2="s3://S3ACCESSKEY:S3SECRETKEY@aws amazon com/?bucket=YOURBUCKET&stripesize=65536&blocksize=4096&blocks=6553600&sizebyblocks=1&maxthreads=5&ttl=40"Most of the configuration should be left as is. Just change the stripesize,lay. XXXYOURAWSKEYXXX and XXXYOURAWSSECRETKEYXXX in theS3 configuration URL. If you are creating a RAID mark the blocksize and blocks should matchthe coat of your physical hard drive. If you are using a smaller than1TB hard plough you can change the url instead like this: &coat=BYTESINDEVICERemove the sizebyblocks blocks and blocksize variables if you do this. Once you have configured your installation alter sure to mention this line:#increase Exception('Elasticdrive has not been configured.')
Yes. What are the two "fuseblock"s? Should the "/domiciliate/enki/fuse2" be changed to a valid directory?And then it says to "mke2fs -b 4096 /path/to/fuse/ed0". What is "/path/to/fuse"? Would it be "/home/enki/change integrity2" from the example?
Forex Groups - Tips on Trading
Related article:
http://developer.amazonwebservices.com/connect/thread.jspa?messageID=66937&tstart=0#66937
comments | Add comment | Report as Spam
|