data-analysis

I have just started using Word2vec and I was wondering how can we find the closest word to a vector suppose. I have this vector which is the average vector for a set of vectors: array([-0.00449447, -0.00310097, 0.02421786, ...], dtype=float32) Is there a straight forward way to find the most similar word in my training data to this vector? Or the only solution is to calculate the cosine similarity between this vector and the vectors of each word in my training data, then select the closest one? Thanks. For gensim implementation of word2vec there is most_similar() function that lets you find

Possible Duplicate: Matlab Cross correlation vs Correlation Coefficient question When I cross correlate 2 data sets a and b (each 73 points long) in MATLAB and graph it, it appears like a triangle with 145 points. I'm confused between the correlation coefficient and the triangle-like graph when I plot the cross correlation output which ranges from +/- 1. I seriously think you need to read up more on cross-correlation functions & correlation coefficient from a statistics book, because your confusion here is more fundamental than related to MATLAB. Unless you know what you're dealing with, you

I will be analysing vast amount of network traffic related data shortly, and will pre-process the data in order to analyse it. I have found that R and SPSS are among the most popular tools for statistical analysis. I will also be generating quite a lot of graphs and charts. Therefore, I was wondering what is the basic difference between these two softwares. I am not asking which one is better, but just wanted to know what are the difference in terms of workflow between the two (besides the fact that SPSS has a GUI). I will be mostly working with scripts in either case anyway so I wanted to

Following the answers of both topics Matplotlib: Plotting numerous disconnected line segments with different colors and matplotlib: how to change data points color based on some variable , I am trying to plot a set of segments given by a list, for instance: data = [(-118, -118), (34.07, 34.16), (-117.99, -118.15), (34.07, 34.16), (-118, -117.98), (34.16, 34.07)] and I would like to plot each segments with a color based on a second list for instance: color_param = [9, 2, 21] with a colormap. So far I am using this line to display the segments: plt.plot(*data) I was expecting that something like

I have a df, Name Step Description Ram 1 Ram is oNe of the good cricketer Ram 2 gopal one Sri 1 Sri is one of the member Sri 2 ravi good Kumar 1 Kumar is a keeper Madhu 1 good boy Vignesh 1 oNe little Pechi 1 one book mario 1 good randokm Roger 1 one milita good bala 1 looks good raj 1 more one venk 1 likes good and a list, my_list=["one","good"] I am trying to get the rows which are having atleast one keyword from my_list. I tried, mask=df["Description"].str.contains("|".join(my_list),na=False) I am getting the output_df, Name Description Ram Ram is one of the good cricketer Sri Sri is one of

I have 3 df's: df1=pd.DataFrame({"Name":["one","two","three"],"value":[4,5,6]}) df2=pd.DataFrame({"Name":["four","one","three"],"value":[8,6,2]}) df3=pd.DataFrame({"Name":["one","four","six"],"value":[1,1,1]}) I can append one by one but I want to append all the three data frames at a time and do some analysis. I am trying to count the name contains in how many data frame divided by total dataframes name present in dataframes/total dataframes My desired output is, Name value Count one 11 1 two 5 0.333 three 8 0.666 four 9 0.666 six 1 0.333 Please help, thanks in advance! Use: first concat