Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
B
BabelZoo
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
PLN
BabelZoo
Commits
3da1e4f1
Unverified
Commit
3da1e4f1
authored
5 years ago
by
PLN (Algolia)
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix(lstm): No space
parent
2fa47a6a
master
No related merge requests found
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
loader.py
KoozDawa/dawa/loader.py
+1
-1
No files found.
KoozDawa/dawa/loader.py
View file @
3da1e4f1
...
...
@@ -28,7 +28,7 @@ def clean_text(lines):
In dataset preparation step, we will first perform text cleaning of the data
which includes removal of punctuations and lower casing all the words.
"""
lines
=
"
"
.
join
(
v
for
v
in
lines
if
v
not
in
string
.
punctuation
)
.
lower
()
lines
=
""
.
join
(
v
for
v
in
lines
if
v
not
in
string
.
punctuation
)
.
lower
()
lines
=
lines
.
encode
(
"utf8"
)
.
decode
(
"ascii"
,
'ignore'
)
return
lines
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment