Characters replaced by question mark when parsing html

Question

I am using HtmlAgilityPack to read a parse a html file and extract some text:

static void Main(string[] args)
        {
            var webGet = new HtmlWeb();
            var document = webGet.Load("http://port.ro/");

            var programs = from program in document.DocumentNode.Descendants()
                           where program.Name == "a" && program.Attributes["href"] != null && program.InnerText.Trim().Length > 0
                           select program.InnerText ;

            foreach (string s in programs)
            {
                Console.WriteLine(s);
            }

            Console.ReadLine();
        }

My problem is that the website contains characters like à and when I print them, they are replaced by ?.

What should I need to do so when I print the text the character à its replaced by a or print it like à ?

possible duplicate of c# unicode string output

CodeCaster
– CodeCaster

2011-11-04 08:29:50 +00:00
Commented Nov 4, 2011 at 8:29 — CodeCaster
– CodeCaster, Commented Nov 4, 2011 at 8:29

Community · Accepted Answer · 2017-05-23 11:55:50Z

1

Did you try using or set the encoding as required for the site. This should help you get the proper text

~~var document = webGet.Load("http://port.ro/", Encoding.UTF8);//check your encoding~~

Above one is for htmldocument

for HtmlWeb Try this:

var web = new HtmlWeb
{
    AutoDetectEncoding = false,
    OverrideEncoding = myEncoding,
};
var doc = web.Load(myUrl);

edited May 23, 2017 at 11:55

CommunityBot

11 silver badge

answered Nov 4, 2011 at 8:32

V4Vendetta

38.5k9 gold badges83 silver badges84 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Adrian Over a year ago

can I use that for the second argument ? I get "invalid arguments"

Adrian Over a year ago

Now it doesn't know about OverrideEncoding, without it I get the same results

V4Vendetta Over a year ago

seems to be an old version, check out the comments in the link and perhaps you should use the latest version

Adrian Over a year ago

Yep the latest version its working, btw do you know what encoding should I use so I dont get 'à' characters, only 'a' ?

Kamil Lach · Accepted Answer · 2011-11-04 08:33:20Z

1

In HtmlAgility there is property to set stream encoding (normaly it should autodetect encoding ) but maybe not working for your page.. (wrong meta tags etc..)

answered Nov 4, 2011 at 8:33

Kamil Lach

4,6392 gold badges22 silver badges20 bronze badges

Collectives™ on Stack Overflow

Characters replaced by question mark when parsing html

2 Answers 2

4 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related