How to properly configure the Amazon EC2 AMI for 'hadoop-ec2'? -

-

i trying launch instance on amazon ec2. have researched problem extensively, have not found helpful information.

when run command hadoop-ec2 launch-cluster mycluster 2, receive following error message:

starting master ami. required parameter 'ami' missing (-h usage)

i have entered aws key, aws secret key, aws key pairs, etc. using hadoop-1.0.4. using default s3 bucket (hadoop-images), have tried many other amis , same error message.

has experience problem before?

the basic issue search images launch-hadoop-master script performs not returning results. cause of due different amis available in different regions (but due changes you've made s3_bucket , hadoop_version in hadoop-ec2-env.sh).

from launch-hadoop-master script:

# finding hadoop image ami_image=`ec2-describe-images -a | grep $s3_bucket                                    | grep $hadoop_version                                   | grep $arch                                   | grep available                                   | awk '{print $2}'`  # start master echo "starting master ami $ami_image"

so, appears ami_image not being set valid image , search amis match various grep filters failing (the defaults hadoop 1.0.4 distribution s3_bucket hadoop-images, hadoop_version 0.19.0 , arch x86 if you're using m1.small instances). if search public amis in us-west-2 region, you'll see there aren't many hadoop images, if search public amis in us-east-1 region, you'll see there quite few. thus, 1 way around issue work in us-east-1 region (this simplest) or, alternatively, set ec2_url in login script via export ec2_url=https://ec2.us-east-1.amazonaws.com need make sure put keys in region aws console.

if did indeed change hadoop_version 1.0.4, i'll note 

ec2-describe-images -a | grep hadoop-images                         | grep "1.0.4"'                        | grep x86                        | grep available

doesn't return images in us-east-1 region. note version (hadoop_version) of hadoop distribution running hadoop-ec2 command not need same version of hadoop images running.

lastly, blunt fix, find ami want use, , force set ami_image image name in launch-hadoop-master , launch-hadoop-cluster scripts.


Comments

Post a Comment

Popular posts from this blog

android - getbluetoothservice() called with no bluetoothmanagercallback -

-
i getting getbluetoothservice() called no bluetoothmanagercallback error in android application. i have no idea causing or bluetooth manager callbacks. can give me idea of causing problem or start looking. by reading android source code, seems warning cannot about. source code shows if call bluetoothsocket#connect(); then call bluetoothadapter.getdefaultadapter().getbluetoothservice(null); the key here, null parameter passes in above line. due this, there no callback, , bluetoothsocket class throw out warning. since warning, not think need it. https://android.googlesource.com/platform/frameworks/base/+/master/core/java/android/bluetooth/bluetoothsocket.java line 306 https://android.googlesource.com/platform/frameworks/base/+/master/core/java/android/bluetooth/bluetoothadapter.java line 1610
Read more

sql - ASP.NET SqlDataSource, like on SelectCommand -

-
i'm working on asp.net. have sqldatasource query hardcoded on selectcommand: <asp:sqldatasource id="datasource1" runat="server" cancelselectonnullparameter="false" connectionstring="<%$ connectionstrings:s.properties.settings.connectionstring %>" selectcommand="select * [table] ([col1] case @col1_param when null col1 else @col1_param end) , ([col2] case @col2_param when null col2 else @col2_param end)" selectcommandtype="text"> <selectparameters> <asp:controlparameter controlid="textbox1" name="col1_param" propertyname="text" type="string" /> <asp:controlparameter controlid="textbox2" name="col2_param" propertyname="text" type="string" /> </selectparameters> what want if enter data on 1 textbox only, data display according textbox
Read more

ios - Undefined symbols for architecture armv7: "_OBJC_CLASS_$_SSZipArchive" -

-
i try using extractzipfile plugin @ this: https://github.com/phonegap/phonegap-plugins/tree/master/ios/extractzipfile but when compiler xcode 4.6.1 in sdk 6.1 throws error: undefined symbols architecture i386: "_objc_class_$_ssziparchive", referenced from: objc-class-ref in extractzipfileplugin.o ld: symbol(s) not found architecture i386 clang: error: linker command failed exit code 1 (use -v see invocation) i try issue @ here: undefined symbols architecture armv7 ssziparchive but shows error: /users/alienware/desktop/extractzipfile/ssziparchive/tests/ssziparchivetests.m:10:9: 'sentestingkit/sentestingkit.h' file not found i work phonegap , make app in ios, dump. update : try add ssziparchive.m compiler source , come new error: undefined symbols architecture i386: "_unzclose", referenced from: +[ssziparchive unzipfileatpath:todestination:overwrite:password:error:delegate:] in ssziparchive.o "_unzclosecurrentfil
Read more