Course Introduction

In this course, we will learn

Programming techniques, specifically functional programming, useful for Big Data Systems.
Basic distributed systems theory, applied on databases and file systems
“Small” data processing
Batch processing
Stream processing
Graph processing

During our course we will learn how to process data with

The course will be using the following 2 programming languages

You can get information about the course schedule here

There will be a resit, there is no mid-term.

You can transfer your assignment grade to the resit AS A WHOLE. No individual assignment resubmissions!

The course consists of 4 mandatory assignments
You always work in pairs: select your team mate!
Grade: \(\frac{\sum_{assign=1}^{4} grade(assign)}{4}\), aka the mean
- No submission? Grade \(\rightarrow\) 0
- Late submission? Grade \(\rightarrow\) 0
We will use Unix for the first assignment, IntelliJ/Scala for all others.
Template files are provided on Brightspace
- Use Maven for assignments 2, 3 and 4 to install all dependencies

We will use CPM. The course name is CSE2520: Big Data Processing

You need to signup to enroll and also declare your pairs
To submit, hit the overview button and select the appropriate assignment
- Pay attention to the instructions about submitting an assignment. Deviating from these may cause automatic grading to fail
All the assignments have deadlines
Feedback and grading is automatic: the results are available on CPM
Technical support: ask the TAs during the labs or via Mattermost
- Feedback on CPM is not instantaneous. Do let the TAs know if no feedback appeared after an hour

Lab sessions every Thursday morning
- All TAs will be around
- Work together to solve assignments
- Ask questions about the next assignment
- Ask questions about your grades
You are welcome to join the BDP 2019-2020 Mattermost channel.

Fire and forget
- Don’t expect TAs to answer
- Don’t expect the course instructors to answer questions
- TAs and instructors do not work outside business hours
Mattermost should be mostly used to exchange opinions and ideas
- Not assignment solutions
No abusive behaviour (swearing, stalking, threatening, sexism etc) will be tolerated

Q A question with a known answer; this will be revealed, but we should work together towards it!
D A open discussion item; we need to think and discuss.

Freely available on the web, on my homepage (http://gousios.org/teaching.html)
You can print/download them before the lecture and bring them along to make additional notes.
I am looking forward to improve them! If you have suggestions, find errors etc, let me know!