You don't use a naked (blind) infinitive with "expect". the expectation is the full infinitive (you need the "to" part). You don't have to use the "to" if you have a noun as the object of expect instead of "you" (or a person), as in "I expect criticism from you", "I expect you to criticize".
You can't say "I expect from you to criticize me" because you lack a direct object of the expectation. You could say "I expect criticism from you" (and then restructure it, somewhat awkwardly, as "I expect, from you, to criticize/complain/pass judgement/cry/scream and holler/whatever"). This only works because the "object" is a generic and undeclared "something" (you will criticize or complain (etc.) and it does not matter about what or who).