Could someone please let me know what does it mean by 'Big Data implementation over Cloud'
I have been using Amazon S3 to store data and query using hive, which I read is one of... moreCould someone please let me know what does it mean by 'Big Data implementation over Cloud'
I have been using Amazon S3 to store data and query using hive, which I read is one of the cloud implementation. I would like to know what exactly does this mean and all possible ways to implement it.
Thanks
I'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error:WARN util.NativeCodeLoader: Unable to load... moreI'm currently configuring hadoop on a server running CentOs. When I run start-dfs.sh or stop-dfs.sh, I get the following error:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicableI'm running Hadoop 2.2.0.Doing a search online brought up this link: http://balanceandbreath.blogspot.ca/2013/01/utilnativecodeloader-unable-to-load.htmlHowever, the contents of /native/ directory on hadoop 2.x appear to be different so I am not sure what to do.I've also added these two environment variables in hadoop-env.sh:export HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=/usr/local/hadoop/lib/"export HADOOP_COMMON_LIB_NATIVE_DIR="/usr/local/hadoop/lib/native/" less
I've been reading a lot of articles that explain the need for an initial set of texts that are classified as either 'positive' or 'negative' before a sentiment analysis system... moreI've been reading a lot of articles that explain the need for an initial set of texts that are classified as either 'positive' or 'negative' before a sentiment analysis system will really work.
My question is: Has anyone attempted just doing a rudimentary check of 'positive' adjectives vs 'negative' adjectives, taking into account any simple negators to avoid classing 'not happy' as positive? If so, are there any articles that discuss just why this strategy isn't realistic?
I was wondering if anybody knew where I could obtain dictionaries of positive and negative words. I'm looking into sentiment analysis and this is a crucial part of it.
I need to delete the topic test in Apache Kafka 0.8.1.1.As expressed in the documentation here, I have executed:bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic... moreI need to delete the topic test in Apache Kafka 0.8.1.1.As expressed in the documentation here, I have executed:bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic testHowever, this results in the following message:Command must include exactly one action: --list, --describe, --create or --alterHow can I delete this topic?
I have recently started looking into querying large sets of CSV data lying on HDFS using Hive and Impala. As I was expecting, I get better response time with Impala compared... more
I have recently started looking into querying large sets of CSV data lying on HDFS using Hive and Impala. As I was expecting, I get better response time with Impala compared to Hive for the queries I have used so far.
I am wondering if there are some types of queries/use cases that still need Hive and where Impala is not a good fit.
How does Impala provide faster query response compared to Hive for the same data on HDFS?
0 While executing any command in hbase shell, I am receiving the following error "ERROR: KeeperErrorCode = NoNode for /hbase/master" in hbase shell.Started HBASE :... more0 While executing any command in hbase shell, I am receiving the following error "ERROR: KeeperErrorCode = NoNode for /hbase/master" in hbase shell.Started HBASE : HOSTCHND:hbase-2.0.0 gvm$ ./bin/start-hbase.sh localhost: running zookeeper, logging to /usr/local/Cellar/hbase-2.0.0/bin/../logs/hbase-gvm-zookeeper-HOSTCHND.local.out running master, logging to /usr/local/Cellar/hbase-2.0.0/logs/hbase-gvm-master-HOSTCHND.local.out : running regionserver, logging to /usr/local/Cellar/hbase-2.0.0/logs/hbase-gvm-regionserver-HOSTCHND.local.outWhile Checking status in HBASE SHELL : hbase(main):001:0> status ERROR: KeeperErrorCode = NoNode for /hbase/master Show cluster status. Can be 'summary', 'simple', 'detailed', or 'replication'. The default is 'summary'. Examples: hbase> status hbase> status 'simple' hbase> status 'summary' hbase> status 'detailed' hbase> status 'replication' hbase> status 'replication', 'source' hbase> status 'replication', 'sink' Took 9.4096 seconds hbase(main):002:0> hbase-site.xml... less
I am new to hive, and want to know if there is anyway to insert data into hive table like we do in SQL. I want to insert my data into hive likeINSERT INTO tablename VALUES... moreI am new to hive, and want to know if there is anyway to insert data into hive table like we do in SQL. I want to insert my data into hive likeINSERT INTO tablename VALUES (value1,value2..)I have read that you can load the data from a file to hive table or you can import data from one table to hive table but is there any way to append the data as in SQL?
I'm looking for ways to present statistical information in my ASP.NET web application. Ease of use is not a priority: I have tried "Microsoft Chart Controls for Microsoft .NET... more
I'm looking for ways to present statistical information in my ASP.NET web application. Ease of use is not a priority: I have tried "Microsoft Chart Controls for Microsoft .NET Framework 3.5" and would like to have much more control on how my data is presented.
Does anyone know a good (preferably open source and cross platform) tool to allow simple visualization of mysql databases? I just need a tool I can quickly point at a database and... moreDoes anyone know a good (preferably open source and cross platform) tool to allow simple visualization of mysql databases? I just need a tool I can quickly point at a database and it'll show basic table structure and field types, etc. Nothing too advanced or crazy.
I'm testing Google Cloud ML for speeding up my ML model using Tensorflow.
Unfortunately, it seems like Google Cloud ML is extremely slow. My Mainstream-Level PC is at least 10x... moreI'm testing Google Cloud ML for speeding up my ML model using Tensorflow.
Unfortunately, it seems like Google Cloud ML is extremely slow. My Mainstream-Level PC is at least 10x faster than Google Cloud ML.
I doubt it uses GPU, so I did a test. I modified a sample code to force using GPU.
diff --git a/mnist/trainable/trainer/task.py b/mnist/trainable/trainer/task.py
index 9acb349..a64a11d 100644
--- a/mnist/trainable/trainer/task.py
+++ b/mnist/trainable/trainer/task.py
@@ -131,11 +131,12 @@ def run_training():
images_placeholder, labels_placeholder = placeholder_inputs(
FLAGS.batch_size)
- # Build a Graph that computes predictions from the inference model.
- logits = mnist.inference(images_placeholder, FLAGS.hidden1, FLAGS.hidden2)
+ with tf.device("/gpu:0"):
+ # Build a Graph that computes predictions from the inference model.
+ logits = mnist.inference(images_placeholder, FLAGS.hidden1, FLAGS.hidden2)
- # Add to the Graph the Ops for loss calculation.
- loss =... less
I'm trying to use the mice package in R for a project and discovered that the pooled results seemed to change the dummy code I had for one of the variables in the output.To... moreI'm trying to use the mice package in R for a project and discovered that the pooled results seemed to change the dummy code I had for one of the variables in the output.To elaborate, let's say I have a factor, foo, with two levels: 0 and 1. Using a regular lm would typically yield an estimate for foo1. Using mice and the pool function, however, yields an estimate for foo2. I included a reproducible example below using the nhanes dataset from the mice package. Any ideas why the might be occurring?require(mice)# Create age as: 0, 1, 2nhanes$age <- as.factor(nhanes$age - 1)head(nhanes)# age bmi hyp chl# 1 0 NA NA NA# 2 1 22.7 1 187# 3 0 NA 1 187# 4 2 NA NA NA# 5 0 20.4 1 113# 6 2 NA NA 184# Use a regular lm with missing data just to see output# age1 and age2 come up as expectedlm(chl ~ age + bmi, data = nhanes)# Call:# lm(formula = chl ~ age + bmi, data = nhanes)# Coefficients:# (Intercept) age1 age2 bmi # -28.948 55.810 104.724 6.921 imp <- mice(nhanes)str(complete(imp)) # still the same codingfit <-... less
I'm currently trying to visualize the learned filters of my CNN with tensorflow in python. I found many versions working with the mnist dataset while training a new network,... more
I'm currently trying to visualize the learned filters of my CNN with tensorflow in python. I found many versions working with the mnist dataset while training a new network, but wasn't able to apply it to my application. I trained an Estimator object, which is stored on my disk, with a custom dataset. The model contains layers such as
<span class="pln">conv1 </span><span class="pun">=</span><span class="pln"> tf</span><span class="pun">.</span><span class="pln">layers</span><span class="pun">.</span><span class="pln">conv2d</span><span class="pun">(</span><span class="pln">inputs</span><span class="pun">=</span><span class="pln">input_layer</span><span class="pun">,</span><span class="pln"> filters</span><span class="pun">=</span><span class="lit">32</span><span class="pun">,</span><span class="pln"> kernel_size</span><span class="pun">=,</span><span class="pln"> padding</span><span class="pun">=</span><span class="str">"same"</span><span class="pun">,</span><span class="pln">... less
Our existing IoT Platform uses Azure Protocol Gateway and is working well. I just realized that MS Azure has launched a newer version for Protocol Gateway called IoT Edge. I was... moreOur existing IoT Platform uses Azure Protocol Gateway and is working well. I just realized that MS Azure has launched a newer version for Protocol Gateway called IoT Edge. I was just looking for the new feature available in IoT Edge and now I'm completely confused between both components:
IoT Edge majorly supports local connectivity between device and gateway. What if this is not part of my requirement? Should I still upgrade to IoT Edge?
I don't see any performance improvements - Protocol Gateway vs Iot Edge
I understand that the answer could be a broader discussion but can anyone provide a simple explanation? less
I built a Logistic Regression model that classifies whether a customer churns or not and I would like to evaluate the performance of the model. I would like to understand the... moreI built a Logistic Regression model that classifies whether a customer churns or not and I would like to evaluate the performance of the model. I would like to understand the best evaluation metrics for this problem.
What do the metrics Sensitivity, Specificity, False Positives Rate, Precision, Recall, and Accuracy tell us about this model?