FYI these seem to sell for around $1700 (each). 

I have 3 x 12GB RTX 3060s if that helps. $1100 for all three. I realise this isnt what you are asking for, but it looks like you are actually after VRAM for running LLMs rather than compute.

Reasonable price is going to be difficult, the last auction for a rtx 4090 on trademe went for $4200.

Otherwise it’s AMD’s 7900 24GB line if you aren't after nvidia specifically.

Spartan, yeahhhh I know a 4090 probably won't work for me (unless I get lucky with pricing as I'd spend a few hundred more on a 4090 but not thousands more than a 3090), but I'd be ok with paying 1700 for a 3090 as cddt suggested 

Daniel, hmmmm... not what I had in mind, but maaaaaybe?

Will need to research if 3x 3060 will work with my case/PSU, and what sort of speed hit and extra complexity overhead this will mean.

Are you in Auckland?

If he's not in Auckland, - I can help you with some test hardware with multi 3060s

DM me,  if you want to borrow some to play. 

Im in Hamilton.

SpartanVXL:

 

Otherwise it’s AMD’s 7900 24GB line if you aren't after nvidia specifically.

 

Not badly priced at ~$1500 at the moment as well

shanes:

 

SpartanVXL:

 

Otherwise it’s AMD’s 7900 24GB line if you aren't after nvidia specifically.

 

 

Not badly priced at ~$1500 at the moment as well

 

PB Tech does seem to put the cheapest model on sale from time to time at ~$1399. 

I have a GALAX GeForce RTX 3090 with original retail packaging for $1950 and I also have an ASUS TUF GeForce RTX 4090 original retail packaging for $4000.

Both work great, no issues. The 3090 was used in a gaming rig, the 4090 used exclusively for AI. Prices are firm but I can look at listing them on Trade Me if you want to buy them using Ping, if you cover the fee.

Reach out to me if you're interested. 

Might have found the ultimate "Open weights on a low low budget" option:

https://www.alibaba.com/product-detail/Hot-Sale-Rtx-2080-Ti-22g_1601164671906.html

(Only NZ$555, plus shipping/taxes/etc, for 22GB of vRAM!)

My understanding is, the 2000 series has a very early form of the Cuda cores. 

While thoes 2080tis have enough ram - you might find the Tokens per second lowdue to the older series of Cuda cores.

My understand is the 3000 series are significantly better Cuda cores, then only marginal improvement on to the 4000 and 5000 series GPUs

I do have a Zotac 3090 Ti AMP extreme holo in my gaming rig that I could be persuaded into parting with.

Only been gamed on. 

Not sure what I'd replace it with though. 

I also have a 3090 but I am hesitant to let it go as there is literally 0 good and well priced upgrades.

concordnz:

 

My understanding is, the 2000 series has a very early form of the Cuda cores. 

 

While thoes 2080tis have enough ram - you might find the Tokens per second lowdue to the older series of Cuda cores.

 

My understand is the 3000 series are significantly better Cuda cores, then only marginal improvement on to the 4000 and 5000 series GPUs

 

Yeah I think also the true cost of that Alibaba deal once it is landed in NZ might be closer to $750+gst, which makes the 3080 20GB at NZ$1K look a lot more reasonable for the speed performance and better compatibility with current models.

https://ebay.io/m/kbvnYy

Or if I stick with Alibaba:

https://www.alibaba.com/product-detail/Good-Quality-RTX-3080-20GB-Graphics_1601612164521.html

Dairusire:

 

I do have a Zotac 3090 Ti AMP extreme holo in my gaming rig that I could be persuaded into parting with.

 

Only been gamed on. 

 

Not sure what I'd replace it with though. 

 

MaxineN:

 

I also have a 3090 but I am hesitant to let it go as there is literally 0 good and well priced upgrades.

 

Yup, anything other than a 3090 when it comes to gaming at least, is either a big downgrade (or at best, a somewhat sideways move) or is a *very* expensive upgrade $$$$, that just isn't worth it (unless you arr made out of money)