Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
2
2020_21 J-25
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
3
Merge Requests
3
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
2020_21 J-25
2020_21 J-25
Commits
2eacca06
Commit
2eacca06
authored
Jul 09, 2021
by
Ramachandran Rajeevaletshanth
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Update 4.Text_Preprocessing.py
parent
381b4c9d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
4 deletions
+6
-4
IT17163682/4.Text_Preprocessing.py
IT17163682/4.Text_Preprocessing.py
+6
-4
No files found.
IT17163682/4.Text_Preprocessing.py
View file @
2eacca06
...
...
@@ -9,8 +9,10 @@ from collections import Counter
import
re
import
unidecode
res
=
open
(
"ResumeStr.txt"
)
.
read
()
tweet
=
open
(
'Tweet.txt'
)
.
read
()
#nltk.download('stopwords')
res
=
open
(
"Experience.txt"
,
'r'
,
encoding
=
'utf-8'
)
.
read
()
tweet
=
open
(
'Tweet.txt'
,
'r'
,
encoding
=
'utf-8'
)
.
read
()
#Lower case conversion
def
lower_case_convertion
(
text
):
...
...
@@ -87,7 +89,7 @@ def lemmatization(text):
# initialize lemmatizer object
lemma
=
WordNetLemmatizer
()
res
=
lemmatization
(
res
)
tweet
=
lemmatization
(
tweet
)
# Implementation of removing punctuations using string library
def
remove_punctuation
(
text
):
...
...
@@ -227,7 +229,7 @@ tweet = '\n'.join(k)
#print(res)
#print(tweet)
with
open
(
"
ClearText
.txt"
,
"w"
)
as
text_file
:
with
open
(
"
Experience
.txt"
,
"w"
)
as
text_file
:
print
(
res
,
file
=
text_file
)
with
open
(
"Tweet.txt"
,
"w"
)
as
text_file
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment