Searched refs:UTF (Results 1 - 25 of 34) sorted by relevance

12

/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/Encode/lib/Encode/Unicode/
H A DUTF7.pm8 __PACKAGE__->Define('UTF-7');
25 my $e_utf16 = find_encoding("UTF-16BE");
82 Encode::Unicode::UTF7 -- UTF-7 encoding
87 $utf7 = encode("UTF-7", $utf8);
88 $utf8 = decode("UTF-7", $ucs2);
92 This module implements UTF-7 encoding documented in RFC 2152. UTF-7,
93 as its name suggests, is a 7-bit re-encoded version of UTF-16BE. It
95 exchange Unicoded mails via mails. But with the advent of UTF-8 and
96 8-bit compliant MTAs, UTF
[all...]
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/lib/CGI/t/
H A Dcharset.t18 $q->charset('UTF-8');
20 like($out, qr{Content-Type: text/plain; charset=UTF-8}, "setting charset alters header of text/plain");
23 $q->charset('UTF-8');
25 like($out, qr{Content-Type: application/json; charset=UTF-8}, "setting charset alters header of application/json");
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/Encode/Unicode/
H A DUnicode.pm18 our %BOM_Unknown = map {$_ => 1} qw(UTF-16 UTF-32);
20 for my $name (qw(UTF-16 UTF-16BE UTF-16LE
21 UTF-32 UTF-32BE UTF-32LE
78 for UTF-8, which is a native format in perl).
86 UTF
[all...]
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/lib/
H A Dutf8.pm27 utf8 - Perl pragma to enable/disable UTF-8 (or UTF-EBCDIC) in source code
34 # Convert a Perl scalar to/from UTF-8.
38 # Change the native bytes of a Perl scalar to/from UTF-8 bytes.
47 The C<use utf8> pragma tells the Perl parser to allow UTF-8 in the
48 program text in the current lexical scope (allow UTF-EBCDIC on EBCDIC based
54 in future we would like to standardize on the UTF-8 encoding for
58 script is written in UTF-8.> The utility functions described below are
62 Until UTF-8 becomes the default format for source text, either this
63 pragma or the L</encoding> pragma should be used to recognize UTF
[all...]
H A Dbytes.pm59 in UTF-8 and stores it in $x. Then it is marked as character data, so,
H A DPerlIO.pm125 characters. (Which really is UTF-8 on ASCII machines, but is
126 UTF-EBCDIC on EBCDIC machines.) This allows any character perl can
127 represent to be read from or written to the stream. The UTF-X encoding
131 Here is how to write your native data out using UTF-8 (or UTF-EBCDIC)
162 want UTF-8 or encoding defaults the appropriate thing to do is to add
177 will construct a "binary" stream, but then enable UTF-8 translation.
H A Dopen.pm251 (in that order) are matched for anything looking like UTF-8, and if
258 contain the strings 'UTF-8' or 'UTF8' (case-insensitive matching),
260 B<any subsequent file open>, is UTF-8.
H A Dutf8.t11 # Since you don't have perlio you might get failures with UTF-8 locales.
136 # I don't want to use map {ord} and I've no need to hardcode the UTF
171 qr/^Malformed UTF-8 character \(\d bytes?, need \d, .+\).*start\d+,end$/sm
276 skip("Embedded UTF-8 does not work in EBCDIC", 1) if ord("A") == 193;
330 skip("Embedded UTF-8 does not work in EBCDIC", 1) if ord("A") == 193;
391 # encode() clears the UTF-8 flag (unlike upgrade()).
409 ok( utf8::is_utf8($b), " utf8::is_utf8 beyond"); # $b stays in UTF-8.
H A DDBM_Filter.pm507 in UTF-8.
588 keys as C ints and the values and null terminated UTF-8 strings. Here
H A Dlocale.t352 push @enc, "$_.UTF-8";
532 $badutf8 = $_[0] =~ /Malformed UTF-8/;
538 debug "# Locale name contains bad UTF-8, skipping test 99 for locale '$Locale'\n";
884 "# because UTF-8 and locales do not work together in Perl.\n#\n";
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/t/op/
H A Dutf8decode.t14 print "1..0 # Skip: UTF-EBCDIC (not UTF-8) used here\n";
28 # This table is based on Markus Kuhn's UTF-8 Decode Stress Tester,
29 # http://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-test.txt,
36 1 Correct UTF-8
114 5.1 Single UTF-16 surrogates
115 5.1.1 n "\xed\xa0\x80" - 3 ed:a0:80 - UTF-16 surrogate 0xd800
116 5.1.2 n "\xed\xad\xbf" - 3 ed:ad:bf - UTF-16 surrogate 0xdb7f
117 5.1.3 n "\xed\xae\x80" - 3 ed:ae:80 - UTF-16 surrogate 0xdb80
118 5.1.4 n "\xed\xaf\xbf" - 3 ed:af:bf - UTF
[all...]
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/PerlIO/t/
H A Dencoding.t46 if (open(UTF, "<$utf")) {
47 binmode(UTF, ":bytes");
49 # alpha beta gamma in UTF-EBCDIC Unicode (0x3b1 0x3b2 0x3b3)
50 print "not " unless <UTF> eq "\xb4\x58\xb4\x59\xb4\x62";
52 # alpha beta gamma in UTF-8 Unicode (0x3b1 0x3b2 0x3b3)
53 print "not " unless <UTF> eq "\xce\xb1\xce\xb2\xce\xb3";
56 close UTF;
138 # Create a string of chars that are 3 bytes in UTF-8
146 # Read file back as UTF-8
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/lib/DBM_Filter/
H A Dutf8.pm39 in UTF-8.
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/Encode/lib/Encode/MIME/
H A DHeader.pm135 use constant HEAD => '=?UTF-8?';
195 MIME-Header Both B and Q =?UTF-8?B?....?=
196 MIME-B B only; Q croaks =?UTF-8?B?....?=
197 MIME-Q Q only; B croaks =?UTF-8?Q?....?=
207 When you encode, it just encodes UTF-8 string with I<X> encoding then
208 quoted with =?UTF-8?I<X>?....?= . The parts that RFC 2047 forbids to
216 These days major mail agents all support =?UTF-8? so I think it is
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/Encode/
H A Dencoding.pm26 qw(utf8 UCS-2BE UCS-2LE UTF-16 UTF-16BE UTF-16LE
27 UTF-32 UTF-32BE UTF-32LE);
140 characters -- so long as the script was written in UTF-8. But back
141 then, text editors that supported UTF-8 were still rare and many users
174 the code in UTF-8:
206 utf8::encode($string); # now it's a UTF
[all...]
H A DEncode.pm400 string. See L</"The UTF-8 flag"> below.
421 ASCII data (or EBCDIC on EBCDIC machines). See L</"The UTF-8 flag">
451 Both #1 and #2 make $data consist of a completely valid UTF-8 string
456 See L</"The UTF-8 flag"> below.
463 characters have a UTF-8 representation so this function cannot fail.
470 $octets is decoded from UTF-8 into a sequence of logical
471 characters. Not all sequences of octets form valid UTF-8 encodings, so
569 If the data is supposed to be UTF-8, an optional lexical warning
660 =head1 The UTF-8 flag
695 of the UTF
[all...]
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/Encode/lib/Encode/
H A DAlias.pm131 # UTF/UCS stuff
132 define_alias( qr/^UTF-?7$/i => '"UTF-7"');
135 qr/^UCS-?4-?(BE|LE)?$/i => 'uc("UTF-32$1")',
137 define_alias( qr/^UTF(16|32)-?BE$/i => '"UTF-$1BE"',
138 qr/^UTF(16|32)-?LE$/i => '"UTF-$1LE"',
139 qr/^UTF(16|32)$/i => '"UTF
[all...]
H A DEncoder.pm125 your UTF-8 string converted to Latin1 then Base64: you can simply say
H A DGuess.pm82 return find_encoding('UTF-16')
85 return find_encoding('UTF-32')
87 if ($octet =~ /\x00/o){ # if \x00 found, we assume UTF-(16|32)(BE|LE)
90 if ($octet =~ /\x00\x00/o){ # UTF-32(BE|LE) assumed
91 $utf = "UTF-32";
96 }else{ # UTF-16(BE|LE) assumed
97 $utf = "UTF-16";
187 By default, it checks only ascii, utf8 and UTF-16/32 with BOM.
189 use Encode::Guess; # ascii/utf8/BOMed UTF
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/
H A Dtoke.c43 # define UTF (!IN_BYTES) macro
45 # define UTF ((PL_linestr && DO_UTF8(PL_linestr)) || (PL_hints & HINT_UTF8)) macro
257 else if (PL_oldoldbufptr && isIDFIRST_lazy_if(PL_oldoldbufptr,UTF)) {
259 for (t = PL_oldoldbufptr; *t && (isALNUM_lazy_if(t,UTF) || *t == ':'); t++) ;
677 for (s = PL_last_uni; isALNUM_lazy_if(s,UTF) || *s == '-'; s++) ;
771 if (isIDFIRST_lazy_if(s,UTF) ||
788 if (UTF && !IN_BYTES && is_utf8_string((U8*)PL_tokenbuf, len))
1225 I32 this_utf8 = UTF; /* The source string is assumed to be UTF8 */
1360 && (isALNUM_lazy_if(s+1,UTF) || strchr(":'{$+-", s[1])))
1465 * escapes will be longer than any UTF
[all...]
H A Dregexec.c92 #define UTF ((PL_reg_flags & RF_utf8) != 0) macro
409 "UTF-8 regex...\n"));
423 "UTF-8 target...\n"));
592 /* XXXX May be hopelessly wrong for UTF... */
1016 if (UTF) {
1079 m, (char **)0, ln, (bool)UTF))
1091 (char **)0, ln, (bool)UTF))
1118 m, (char **)0, ln, (bool)UTF))
1130 (char **)0, ln, (bool)UTF))
1714 char *s0 = UTF
[all...]
H A Dregcomp.c235 #define UTF (RExC_utf8 != 0) macro
242 #define CHR_SVLEN(sv) (UTF ? sv_len_utf8(sv) : SvCUR(sv))
243 #define CHR_DIST(a,b) (UTF ? utf8_distance(a,b) : a - b)
736 if (UTF && OP(scan) == EXACTF && STR_LEN(scan) >= 6) {
745 Unicode UTF-8
751 as Unicode calls it), an EXACTF of length six (the UTF-8 encoded byte
753 of length two (the byte length of UTF-8 encoded U+0390 or U+03B0).
760 Thanks to the design of UTF-8, there cannot be false matches:
761 A sequence of valid UTF-8 bytes cannot be a subsequence of
762 another valid sequence of UTF
[all...]
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/PerlIO/via/
H A Dvia.pm81 UTF-8 encoded. If it returns true result is as if caller had done
88 and that layer was expecting UTF-8.
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/lib/CPAN/
H A DFirstTime.pm213 terminal supports UTF-8, you say no to the next question, if it
217 will be output in UTF-8.
/osnet-11/usr/src/cmd/perl/5.8.4/distrib/ext/Digest/MD5/
H A DMD5.pm293 What you can do is calculate the MD5 checksum of the UTF-8

Completed in 1459 milliseconds

12