How to properly configure the Amazon EC2 AMI for 'hadoop-ec2'? -

-

i trying launch instance on amazon ec2. have researched problem extensively, have not found helpful information.

when run command hadoop-ec2 launch-cluster mycluster 2, receive following error message:

starting master ami. required parameter 'ami' missing (-h usage)

i have entered aws key, aws secret key, aws key pairs, etc. using hadoop-1.0.4. using default s3 bucket (hadoop-images), have tried many other amis , same error message.

has experience problem before?

the basic issue search images launch-hadoop-master script performs not returning results. cause of due different amis available in different regions (but due changes you've made s3_bucket , hadoop_version in hadoop-ec2-env.sh).

from launch-hadoop-master script:

# finding hadoop image ami_image=`ec2-describe-images -a | grep $s3_bucket                                    | grep $hadoop_version                                   | grep $arch                                   | grep available                                   | awk '{print $2}'`  # start master echo "starting master ami $ami_image"

so, appears ami_image not being set valid image , search amis match various grep filters failing (the defaults hadoop 1.0.4 distribution s3_bucket hadoop-images, hadoop_version 0.19.0 , arch x86 if you're using m1.small instances). if search public amis in us-west-2 region, you'll see there aren't many hadoop images, if search public amis in us-east-1 region, you'll see there quite few. thus, 1 way around issue work in us-east-1 region (this simplest) or, alternatively, set ec2_url in login script via export ec2_url=https://ec2.us-east-1.amazonaws.com need make sure put keys in region aws console.

if did indeed change hadoop_version 1.0.4, i'll note 

ec2-describe-images -a | grep hadoop-images                         | grep "1.0.4"'                        | grep x86                        | grep available

doesn't return images in us-east-1 region. note version (hadoop_version) of hadoop distribution running hadoop-ec2 command not need same version of hadoop images running.

lastly, blunt fix, find ami want use, , force set ami_image image name in launch-hadoop-master , launch-hadoop-cluster scripts.


Comments

Post a Comment

Popular posts from this blog

javascript - Image onload event not firing in firefox -

-
i'm creating image preloader. works fine in browsers except firefox (testing firefox 10.0). input array of images called image_list . these images appended dynamically body of document , load callback attached, calls function update_progress . code follows: $(image_list).each(function() { var x = $('<img />') .load(function() {update_progress(percent_loaded += step);}) .attr('src', this) .appendto('body') .css('display', 'none'); .each(function() { if(this.complete) update_progress(percent_loaded += step); }); }); in firefox, load callback , update_progress never called. yet exact same code works fine in chrome , other browsers i've tested. there way detect when image has loaded in firefox? i first check see whether image has height, checking height property. if (the_image.height > 0) { // image loaded (possibly cached) } if have cached ...
Read more

android - getbluetoothservice() called with no bluetoothmanagercallback -

-
i getting getbluetoothservice() called no bluetoothmanagercallback error in android application. i have no idea causing or bluetooth manager callbacks. can give me idea of causing problem or start looking. by reading android source code, seems warning cannot about. source code shows if call bluetoothsocket#connect(); then call bluetoothadapter.getdefaultadapter().getbluetoothservice(null); the key here, null parameter passes in above line. due this, there no callback, , bluetoothsocket class throw out warning. since warning, not think need it. https://android.googlesource.com/platform/frameworks/base/+/master/core/java/android/bluetooth/bluetoothsocket.java line 306 https://android.googlesource.com/platform/frameworks/base/+/master/core/java/android/bluetooth/bluetoothadapter.java line 1610
Read more

sql - ASP.NET SqlDataSource, like on SelectCommand -

-
i'm working on asp.net. have sqldatasource query hardcoded on selectcommand: <asp:sqldatasource id="datasource1" runat="server" cancelselectonnullparameter="false" connectionstring="<%$ connectionstrings:s.properties.settings.connectionstring %>" selectcommand="select * [table] ([col1] case @col1_param when null col1 else @col1_param end) , ([col2] case @col2_param when null col2 else @col2_param end)" selectcommandtype="text"> <selectparameters> <asp:controlparameter controlid="textbox1" name="col1_param" propertyname="text" type="string" /> <asp:controlparameter controlid="textbox2" name="col2_param" propertyname="text" type="string" /> </selectparameters> what want if enter data on 1 textbox only, data display according textbox...
Read more