首页
网站开发
桌面应用
管理软件
微信开发
App开发
嵌入式软件
工具软件
数据采集与分析
其他
首页
>
> 详细
代写program、代做Java编程语言
项目预算:
开发周期:
发布时间:
要求地区:
School of Computing & Information Technology University of Wollongong
ISIT312 Big Data Management SIM S4 2024 Assignment 1
Scope
The objectives of Assignment 1 include implementation of HDFS applications, implementation of simple MapReduce applications, and describing an implementation of complex MapReduce applications.
This assignment is due on 20 October 2024 by 9:00 pm Singaporean Time (SGT).
This assignment is worth 10% of the total evaluation in the subject.
The assignment consists of 3 tasks and the specification of each task starts from a new page.
Only electronic submission through Moodle at:
https://moodle.uowplatform.edu.au/login/index.php
will be accepted. A submission procedure is explained at the end of Assignment 1 specification.
A policy regarding late submissions is included in the subject outline. Only one submission of Assignment 1 is allowed and only one submission per student is accepted.
A late submission penalty (25% of the total mark) will be applied for every 24 hours late.
A submission that contains an incorrect file attached is treated as a correct submission with all consequences coming from the evaluation of the file attached.
All files left on Moodle in a state "Draft(not submitted)" will not be evaluated.
An implementation that does not compile well due to one or more syntactical and/or run time
errors scores no marks.
The first assignment is an individual assignment and it is expected that all its tasks will be solved individually without any cooperation with the other students. However, it is allowed to declare in the submission comments that a particular component or task of this assignment has been implemented in cooperation with another student. In such a case evaluation of a task or component may be shared with another student. In all other cases plagiarism will result in a FAIL grade being recorded for entire assignment. If you have any doubts, questions, etc. please consult your lecturer or tutor during laboratory/tutorial classes or over e-mail.
Session: 4, 2024
Lecturer: Dr Fenghui Ren
Task 1 (3 marks)
Implementation of HDFS application
Implement a HDFS application that merges two files located in HDFS into one file also located in HDFS.
file.
Perform the following steps.
Implement the application and save its source code in a file solution1.java.
When ready, compile, create jar file, and process your application. Display the results created by the application.
Use Hadoop to provide a piece of evidence that two files uploaded into HDFS have been successful merged into one file in HDFS.
Deliverables
A file solution1.java with a source code of the application that merges two HDFS files. A file solution1.pdf that contains
two files uploaded into HDFS has been successful merges in one file in HDFS with explanation of how the statements work.
The application must have the following parameters.
(1) A path to, and a name of the first input file in HDFS.
(2) A path to, and a name of the second input file in HDFS.
(3) A path to, and a new name of an output file to be created in HDFS. The file is supposed
to contain the contents of the first input file followed by the contents of the second input
Upload two files to HDFS. The contents, the name, and the locations of the files in HDSF are
up to you.
the contents of Terminal window with a report from
compilation, creation of jar file, uploading to HDFS two small files for testing, processing of
the application, and evidence that
Task 2 (4 marks)
Implementation of MapReduce application
Assume, that a speed camera records the speed of passing cars and saves the measurements in a text file. The speed of each car is measured in kilometres per hour. A single row in the file contains a car registration number, a location of the camera, a date when the speed has been measured, and the speed of a car with the recorded registration number. The values are always separated with a single blank.
For example, a sample file (SpeedCamera.txt) with the speed measurements contains the following lines:
PKR856 AYE 14-NOV-2021 80
UPS234 CTE 20-FEB-2022 110
PKR856 PIE 20-MAR-2020 90
PKR856 PIE 17-JUN-2021 100
UPS234 CTE 22-SEP-2022 100
UPS234 CTE 03-AUG-2020 90
Assume, that a speed limit in a location of the speed camera is 90 kilometres per hour.
Your task is to implement a MapReduce application, that finds an average speed of all cars,
that exceeded a speed limit in the location of the speed camera.
An input file with the speed measurements must include the lines listed above and it must contain at least 20 measurements. All additional measurements are up to you.
Save your solution in a file solution2.java.
When ready, compile, create a jar file, and process your application. Display the results created by the application. The result of your application includes (1) the content of your input
file, (2) the car registration number, the location of the camera, and the average speed that exceed the speed limit. When finished, Copy and Paste the messages from a Terminal screen into a file solution2.pdf.
A sample output of the application is as follows:
Deliverables
A file solution2.java with a source code of the application that implement the functionality of the problem statement specified above. A file
from the compilation of your code, the creation of the jar file, the processing of your application, the listing of your input file with the speed measurements , and the results of
solution2.pdf with a report
processing the solution2.java.
Task 3 (3 marks)
Implementation of MapReduce application
An application MinMax described in an Exercise 2 has the functionality the same as the following SQL statement.
SELECT key, MIN(value), MAX(value)
FROM Sequence-of-key-value-pairs
GROUP BY key;
Extend Java code of the application such that it implements the functionality the same as the following SQL statement.
SELECT key, MAX(value), MIN(value), AVG(value), SUM(value) FROM Sequence-of-key-value-pairs
GROUP BY key;
Save your solution in a file solution3.java.
When ready, compile, create the jar file, and process your application. To test your application, you can use a file sales.txt included in the zipped file of this specification. Display the results created by the application. When finished, Copy and Paste the messages from a Terminal screen into a file solution3.pdf.
A sample output of the application is as follows:
Deliverables
A file solution3.java with a source code of the application that implement the functionality of SELECT statement given above. A file
compilation, creation of the jar file, processing of your application, and screen captures of
solution3.pdf with a report from
the results of processing solution3.java.
Submission of Assignment 1
Note, that you have only one submission. So, make absolutely sure that you submit the correct files with the correct contents. Please submit an Academic Consideration in SOLS if an extension (1 week maximally) is required.
Please combine the files solution1.pdf, solution2.pdf, and solution3.pdf as a single pdf (solutions.pdf) first, then zip the files solutions.pdf, solution1.java, solution2.java, and solution3.java into a single zipped file (A1-solutions.zip). Please submit the zipped file through Moodle in the following way:
(1) Access Moodle at http://moodle.uowplatform.edu.au/
(2) To login use a Login link located in the right upper corner the Web page or in the
middle of the bottom of the Web page
(3) When logged select a site ISIT312 (SP424) Big Data Management
(4) Scroll down to a section SUBMISSIONS
(5) Click at Assignment 1 link.
(6) Click at a button Add Submission
(7) Move the zipped file A1-solutions.zip into an area You can drag and
drop files here to add them. You can also use a link Add...
(9) Click at a button Save changes
(10) Click at a button Submit assignment
(11)Click at the checkbox with a text attached: By checking this box, I
confirm that this submission is my own work, ... in order to
confirm authorship of your submission. (12) Click at a button Continue
End of specification
软件开发、广告设计客服
QQ:99515681
邮箱:99515681@qq.com
工作时间:8:00-23:00
微信:codinghelp
热点项目
更多
代写math 1151, autumn 2024 w...
2024-11-14
代做comp4336/9336 mobile dat...
2024-11-14
代做eesa01 lab 2: weather an...
2024-11-14
代写comp1521 - 24t3 assignme...
2024-11-14
代写nbs8020 - dissertation s...
2024-11-14
代做fin b377f technical anal...
2024-11-14
代做ceic6714 mini design pro...
2024-11-14
代做introduction to computer...
2024-11-14
代做cs 353, fall 2024 introd...
2024-11-14
代做phy254 problem set #3 fa...
2024-11-14
代写n1569 financial risk man...
2024-11-14
代写csci-ua.0202 lab 3: enco...
2024-11-14
代写econ2226: chinese econom...
2024-11-14
热点标签
mktg2509
csci 2600
38170
lng302
csse3010
phas3226
77938
arch1162
engn4536/engn6536
acx5903
comp151101
phl245
cse12
comp9312
stat3016/6016
phas0038
comp2140
6qqmb312
xjco3011
rest0005
ematm0051
5qqmn219
lubs5062m
eee8155
cege0100
eap033
artd1109
mat246
etc3430
ecmm462
mis102
inft6800
ddes9903
comp6521
comp9517
comp3331/9331
comp4337
comp6008
comp9414
bu.231.790.81
man00150m
csb352h
math1041
eengm4100
isys1002
08
6057cem
mktg3504
mthm036
mtrx1701
mth3241
eeee3086
cmp-7038b
cmp-7000a
ints4010
econ2151
infs5710
fins5516
fin3309
fins5510
gsoe9340
math2007
math2036
soee5010
mark3088
infs3605
elec9714
comp2271
ma214
comp2211
infs3604
600426
sit254
acct3091
bbt405
msin0116
com107/com113
mark5826
sit120
comp9021
eco2101
eeen40700
cs253
ece3114
ecmm447
chns3000
math377
itd102
comp9444
comp(2041|9044)
econ0060
econ7230
mgt001371
ecs-323
cs6250
mgdi60012
mdia2012
comm221001
comm5000
ma1008
engl642
econ241
com333
math367
mis201
nbs-7041x
meek16104
econ2003
comm1190
mbas902
comp-1027
dpst1091
comp7315
eppd1033
m06
ee3025
msci231
bb113/bbs1063
fc709
comp3425
comp9417
econ42915
cb9101
math1102e
chme0017
fc307
mkt60104
5522usst
litr1-uc6201.200
ee1102
cosc2803
math39512
omp9727
int2067/int5051
bsb151
mgt253
fc021
babs2202
mis2002s
phya21
18-213
cege0012
mdia1002
math38032
mech5125
07
cisc102
mgx3110
cs240
11175
fin3020s
eco3420
ictten622
comp9727
cpt111
de114102d
mgm320h5s
bafi1019
math21112
efim20036
mn-3503
fins5568
110.807
bcpm000028
info6030
bma0092
bcpm0054
math20212
ce335
cs365
cenv6141
ftec5580
math2010
ec3450
comm1170
ecmt1010
csci-ua.0480-003
econ12-200
ib3960
ectb60h3f
cs247—assignment
tk3163
ics3u
ib3j80
comp20008
comp9334
eppd1063
acct2343
cct109
isys1055/3412
math350-real
math2014
eec180
stat141b
econ2101
msinm014/msing014/msing014b
fit2004
comp643
bu1002
cm2030
联系我们
- QQ: 9951568
© 2021
www.rj363.com
软件定制开发网!