The fastest way would probably be a direct file access.
using (StreamWriter file = File.AppendText("my.log"))
{
file.BaseStream.Seek(-"".Length, SeekOrigin.End);
file.Write(" New error message.");
}
But you lose all the nice XML features and may easily corrupt the file.