- Anagram is a word or phrase made by transposing the letters of another word or phrase.
- An anagram is basically a different arrangement of letters in a word.
- Anagram does not need to be meaningful.
- An anagram is a type of word play, the result of rearranging the letters of a word or phrase to produce a new word or phrase, using all the original letters exactly once
- For example, the word "anagram" can be rearranged into "nagaram". "Elvis" can be rearranged into "lives", therefore "Elvis" and "lives" are anagrams
- Someone who creates anagrams may be called an "anagrammatist"
- Here we work on anagrams, which are only single words.
- The word "mary" can be rearranged into "army"
- The word "secure" is an anagram of "rescue"
- The word "elvis" can be rearranged into "lives"
Write a Spark code to find anagrams in a text file
The file is located at /book/code/anagrams/sample_document.txt
The purpose of these PySpark programs are to find anagrams for a set of given documents.
| Program Name | Description |
|---|---|
anagrams_by_combinebykey.py |
Solution using combineByKey() reducer |
anagrams_by_reducebykey.py |
Solution using reduceByKey() reducer |
anagrams_by_groupbykey.py |
Solution using groupByKey() reducer |
We will ignore words if their length is less than N (we read N as a parameter).
