Unicode to string conversion in Java

Question

I am building a language, a toy language. The syntax \\#0061 is supposed to convert the given Unicode to an character:

String temp = yytext().su         


        

Answer 1

\uXXXX is an escape sequence. Before execution it has already been converted into the actual character value, its not "evaluated" in anyway at runtime.

What you probably want to do is define a mapping from your #XXXX syntax to Unicode code points and cast them to char.

Answer 2

i am basically trying to convert unicode to a character by supplying only '0061' to a method, help.

char fromUnicode(String codePoint) {
  return (char)  Integer.parseInt(codePoint, 16);
}

You need to handle bad inputs and such, but that will work otherwise.

Answer 3

You need to convert the particular codepoint to a char. You can do that with a little help of regex:

String string = "blah #0061 blah";

Matcher matcher = Pattern.compile("\\#((?i)[0-9a-f]{4})").matcher(string);
while (matcher.find()) {
    int codepoint = Integer.valueOf(matcher.group(1), 16);
    string = string.replaceAll(matcher.group(0), String.valueOf((char) codepoint));
}

System.out.println(string); // blah a blah

Edit as per the comments, if it is a single token, then just do:

String string = "0061";
char c = (char) Integer.parseInt(string, 16);
System.out.println(c); // a

Answer 4

Strip the '#' and use Integer.parseInt("0061", 16) to convert the hex digits to an int. Then cast to a char.

(If you had implemented the lexer by hand, an alternatively would be to do the conversion on the fly as your lexer matches the unicode literal. But on rereading the question, I see that you are using a lexer generator ... good move!)