Letter frequencies: plot a histogram ordering the values PYTHON

百般思念 提交于 2021-02-11 12:56:58

问题


What I am trying to do is to analyse the frequency of the letters in a text. As an example, I will use here a small sentence, but all that is thought to analyse huge texts (so it's better to be efficient).

Well, I have the following text:

test = "quatre jutges dun jutjat mengen fetge dun penjat"

Then I created a function which counts the frequencies

def create_dictionary2(txt):
    dictionary = {}
    i=0
    for x in set(txt):
        dictionary[x] = txt.count(x)/len(txt)
    return dictionary

And then

import numpy as np
import matplotlib.pyplot as plt
test_dict = create_dictionary2(test)
plt.bar(test_dict.keys(), test_dict.values(), width=0.5, color='g')

I obtain

ISSUES: I want to see all the letters, but some of them are not seen (Container object of 15 artists) How to expand the histogram? Then, I would like to sort the histogram, to obtain something like from this

this


回答1:


For counting we can use a Counter object. Counter also supports getting key-value pairs on the most common values:

from collections import Counter

import numpy as np
import matplotlib.pyplot as plt

c = Counter("quatre jutges dun jutjat mengen fetge dun penjat")
plt.bar(*zip(*c.most_common()), width=.5, color='g')
plt.show()

The most_common method returns a list of key-value tuples. The *zip(*..) is used to unpack (see this answer).

Note: I haven't updated the width or color to match your result plots.




回答2:


Another solution using pandas:

import pandas as pd
import matplotlib.pyplot as plt

test = "quatre jutges dun jutjat mengen fetge dun penjat"

# convert input to list of chars so it is easy to get into pandas 
char_list = list(test)

# create a dataframe where each char is one row
df = pd.DataFrame({'chars': char_list})
# drop all the space characters
df = df[df.chars != ' ']
# add a column for aggregation later
df['num'] = 1
# group rows by character type, count the occurences in each group
# and sort by occurance
df = df.groupby('chars').sum().sort_values('num', ascending=False) / len(df)

plt.bar(df.index, df.num, width=0.5, color='g')
plt.show()

Result:

Edit: I timed my and ikkuh's solutions

Using counter: 10000 loops, best of 3: 21.3 µs per loop

Using pandas groupby: 10 loops, best of 3: 22.1 ms per loop

For this small dataset, Counter is definately a LOT faster. Maybe i'll time this for a bigger set when i have time.



来源:https://stackoverflow.com/questions/52474028/letter-frequencies-plot-a-histogram-ordering-the-values-python

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!