Big Data
-
Able to Install MongoDB and Compass so that I can create a database. Used proper naming conventions for the naming of a collection and database
-
Able to import .CSV and JSON files. Able to use queries to find answers to specific questions regarding data.
-
Able to use the command line to create databases and collections, insert, update, find, save, drop, delete, and query.
-
Able to use Mongo Import in the command shell. Used $in and $nin, $or, $and, $not, and $nor.
Example: db.movies.find({$or: [{"rating.average": {$lt: 5}}, {"rating.average": {$gt: 9.3}}]}).pretty()
Connect to MongDB
Import CSV File
Run PySpark
Instructions: Submit a JSON object in JSON code to include your first name, the city you live in, the number of grandchildren you have, and your favorite movie.
{
"First Name": "Sunny",
"City": "Honolulu",
"grandkids": 0,
"favorites": {
"sport": "football",
"food": "tacos",
"drink": "Tequila"
}
}
Instructions: Query to find the answers for ‘The Beatles’ bass player before Paul took over, ‘First Lady Helen Taft led a fund-raising drive for a memorial to this 1912 marine disaster, ‘Ping Pong’ & $600, Honolulu is on this Hawaii island, its a top of bounce house, or a dance mad famous by Michael Jackson, a question and answer of your own creation in Jeopardy format.
1. category: ON THE COVER OF SGT. PEPPER", question: "'The Beatles' bass player before Paul took over'", value: "$800", answer: "Stu Sutcliffe", round: "Jeopardy!", show_number : "4335"
2. category: "PEOPLE IN HISTORY", question: "'First Lady Helen Taft led a fund-raising drive for a memorial to this…", value: "$600", answer: "Sinking of the Titanic", show_number: "3751"
3.category: "INTERNATIONAL SPORTSMEN", question: "'Vladimir Samsonov is touted as Europe's only hope against China in the…", value: "$600", answer: "Ping-pong",show_number: "3673"
4. category: "GEOGRAPHY", air_date: "1984-11-29", question: "'Honolulu is on this Hawaiian island'", value: "$200"answer: "Oahu", round: "Double Jeopardy!", show_number: "59"
5. category: "LET'S BOUNCE", question: "'It's a type of bounce house, or a dance made famous by Michael Jackso…", value: "$800", answer: "the moonwalk", show_number: "5957"
6. {
"_id": {
"$oid": "63c9c96e308d8717f7b4d0cc",
"category": "Mixology", "air_date": "2023-01-19",
"question": "A traditional Mexican drink with lime, sweet & sour, and tequila",
"value":"$200", "answer": "Margarita", "round": "Jeopardy!",
"show_number": "2087"
}
}
7. {"answer":"Margarita", "category":"Mixology" }