Is it possible to bundle Nuget with two different packages based on build architecture

I have access to a self-grabbing repository that has two different versions of the package: one 32-bit and one 64-bit.

My dev machine is 32 bit at work, while the build server creates the solution in 64 bit mode. I am currently controlling the build process using ItemGroup conditions, something like this:

<ItemGroup Condition=" '$(Configuration)|$(Platform)' == 'Debug|x64' ">

Is it possible to configure nuget to bind to one package when building in 32-bit mode and the other in 64-bit mode? Or am I stuck in manually editing * proj files?