I don't believe an additional poller install can use more than ~8GB of memory on the server -- all of the processes are 32-bits and so crash when they get larger than 2GB. (I have 10GB free on 16GB servers with ~8000 objects on them). If you stack additional pollers that might be possible to use more memory, but I don't have that kind of install.
Also, on your SQL server if you only have sqlserver standard edition it will only use 64GB of memory; the rest can be used by the operating system to cache disk reads/writes but not directly by the SQLserver process: http://msdn.microsoft.com/en-us/library/ms143685(v=sql.105).aspx