Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
2
2021-118
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
2021_118- Gazette
2021-118
Commits
e77a4cc9
Commit
e77a4cc9
authored
Nov 25, 2021
by
M.S.M.Perera
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Upload read secondary storage function
parent
5ad2e8a8
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
12 deletions
+13
-12
cgp1/CgpApp/views.py
cgp1/CgpApp/views.py
+13
-12
No files found.
cgp1/CgpApp/views.py
View file @
e77a4cc9
...
...
@@ -442,6 +442,19 @@ def SingleUpload(jsObj, name):
client
.
write
(
outputFileName
,
data
=
dumps
(
jsObj
),
overwrite
=
True
)
def
readSecondaryStorage
():
data_
=
[]
path_to_json
=
'dumps/well-structured-final/'
for
file_name
in
[
file
for
file
in
os
.
listdir
(
path_to_json
)
if
file
.
endswith
(
'.json'
)]:
with
open
(
path_to_json
+
file_name
,
encoding
=
'utf-8'
)
as
json_file
:
data
=
json
.
load
(
json_file
)
data_
.
extend
(
data
)
print
(
data
)
return
data_
# data_ = readHadoopDataVacancy()
# data_ = TopicCluster.clustervac(data_)
# for item in data_:
...
...
@@ -487,18 +500,6 @@ def readHadoopDataVacancy():
return
data_
def
readSecondaryStorage
():
data_
=
[]
path_to_json
=
'dumps/well-structured-final/'
for
file_name
in
[
file
for
file
in
os
.
listdir
(
path_to_json
)
if
file
.
endswith
(
'.json'
)]:
with
open
(
path_to_json
+
file_name
,
encoding
=
'utf-8'
)
as
json_file
:
data
=
json
.
load
(
json_file
)
data_
.
extend
(
data
)
print
(
data
)
return
data_
# API configuarations
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment