Here are the only words that Jesus is recorded of speaking to Pilate after the scourging. He notes that the only authority Pilate has over Him is that which has been given from above (John 3:27). Those in positions of authority have that position only because God put them there (Psa 75:6-7, Isa 44:28, Rom 13:1). What Pilate is about to do has been fore-ordained by God as part of His plan (Acts 2:23, 4:27-28) so Pilate really had less authority than what he thought. Note the manner in which Jesus answered Pilate is in accordance with that outlined in Proverbs (Prov 26:4-5).

John 3:27  To this John replied, “A man can receive only what is given him from heaven.

Psalms 75:6-7  No-one from the east or the west or from the desert can exalt a man.  But it is God who judges: He brings one down, he exalts another.

Isaiah 44:28  who says of Cyrus, ‘He is my shepherd and will accomplish all that I please; he will say of Jerusalem, “Let it be rebuilt,” and of the temple, “Let its foundations be laid.”’

Romans 13:1  Everyone must submit himself to the governing authorities, for there is no authority except that which God has established. The authorities that exist have been established by God.

Acts 2:23  This man was handed over to you by God’s set purpose and foreknowledge; and you, with the help of wicked men, put him to death by nailing him to the cross.

Acts 4:27-28  Indeed Herod and Pontius Pilate met together with the Gentiles and the people of Israel in this city to conspire against your holy servant Jesus, whom you anointed.  They did what your power and will had decided beforehand should happen.

Proverbs 26:4-5 (NAS95)  Do not answer a fool according to his folly, Or you will also be like him.  Answer a fool as his folly deserves, That he not be wise in his own eyes.

“the one who handed me over to you” cannot be referring to Judas since he delivered Jesus to the Jews and not to Pilate. It can only mean Caiaphas (John 11:49-50, Matt 26:62-66, John 18:28), who is ultimately responsible . Judas was just a tool, but Caiaphas was the religious leader of Israel and thus responsible for recognizing the Messiah upon His appearance.

John 11:49-50  Then one of them, named Caiaphas, who was high priest that year, spoke up, “You know nothing at all!  You do not realise that it is better for you that one man die for the people than that the whole nation perish.”

Matthew 26:62-66  Then the high priest stood up and said to Jesus, “Are you not going to answer? What is this testimony that these men are bringing against you?”  But Jesus remained silent. The high priest said to him, “I charge you under oath by the living God: Tell us if you are the Christ, the Son of God.”  “Yes, it is as you say,” Jesus replied. “But I say to all of you: In the future you will see the Son of Man sitting at the right hand of the Mighty One and coming on the clouds of heaven.”  Then the high priest tore his clothes and said, “He has spoken blasphemy! Why do we need any more witnesses? Look, now you have heard the blasphemy.  What do you think?” “He is worthy of death,” they answered.

John 18:28  Then the Jews led Jesus from Caiaphas to the palace of the Roman governor. By now it was early morning, and to avoid ceremonial uncleanness the Jews did not enter the palace; they wanted to be able to eat the Passover.

Notice that Jesus uses the word “greater” when referring to the sin of Caiaphas. Greater implies the existence of something lesser: Pilate is not excused from sinning in this matter. Both Pilate and Caiaphas have sinned in abusing their offices and the authority given to them as a trust from God. Note that there are different levels of sin; some are worse than others. However, the penalty for each is the same (Rom 6:23).

Romans 6:23  For the wages of sin is death, but the gift of God is eternal life in Christ Jesus our Lord.