Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
G
gitlab-ce
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
1
Merge Requests
1
Analytics
Analytics
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Commits
Issue Boards
Open sidebar
nexedi
gitlab-ce
Commits
206230a4
Commit
206230a4
authored
May 29, 2012
by
Saito
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
rewrite encode strategy.
parent
89043d6b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
15 additions
and
11 deletions
+15
-11
lib/gitlab/encode.rb
lib/gitlab/encode.rb
+15
-11
No files found.
lib/gitlab/encode.rb
View file @
206230a4
# Patch Strings to enable detect_encoding! on views
require
'charlock_holmes/string'
module
Gitlab
module
Encode
module
Encode
extend
self
def
utf8
message
# return nil if message is nil
return
nil
unless
message
detect
=
CharlockHolmes
::
EncodingDetector
.
detect
(
message
)
rescue
{}
# if message is utf-8 encoding, just return it
message
.
force_encoding
(
"utf-8"
)
return
message
if
message
.
valid_encoding?
#
It's better to default to UTF-8 as sometimes it's wrongly detected as another charse
t
if
detect
[
:encoding
]
&&
detect
[
:confidence
]
==
100
CharlockHolmes
::
Converter
.
convert
(
message
,
detect
[
:encoding
],
'UTF-8'
)
else
message
end
.
force_encoding
(
"utf-8"
)
#
if message is not utf-8 encoding, detect and convert i
t
detect
=
CharlockHolmes
::
EncodingDetector
.
detect
(
message
)
if
detect
[
:encoding
]
&&
detect
[
:confidence
]
>
60
message
.
force_encoding
(
detect
[
:encoding
])
message
.
encode!
(
"utf-8"
,
detect
[
:encoding
],
:undef
=>
:replace
,
:replace
=>
""
,
:invalid
=>
:replace
)
end
# Prevent app from crash cause of
# encoding errors
message
.
valid_encoding?
?
message
:
raise
# Prevent app from crash cause of encoding errors
rescue
"--broken encoding:
#{
encoding
}
"
"--broken encoding:
#{
detect
[
:encoding
]
}
"
end
def
detect_encoding
message
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment