If you go by HP per cubic inch, historically, smaller displacement engines have had the advantage (up to a point). It is easier to make smaller engines more efficient.
If you go horsepower per cubic inch then you aren't truly answering the question which is faster.