I'm searching for an opensource private cloud platform that you can host locally and can provide simplicity and flawlessness like Heroku. Has anyone faced the same problem in past?
Dokku is something I normally use. Running on the smallest Digital Ocean instance.
Another Docker-based solution I currently look at is https://deployit.io - because it wants to offer a very user friendly seamless integration of local, remote self-hosting and remote their-hosting. Open Source, on github.
You might want to check out Deis [0], which is supported and - as far as I know - used by Engine Yard. Also deployed at several other orgs including Mozilla.
I've had a generally positive experience with deis but would recommend just using heroku unless you have the time to really get the deis setup right and keep it right. A system needs to be at least moderately complex before the time spent on deis starts paying dividends.
You also have http://rancher.com/ which makes it pretty easy and has deployment options on local hosts, bare metal or cloud providers (AWS, DO, Exoscale,...)
"cloud platform" and "host locally" are contradictory. Do you mean hosting on your own hardware, a server colocated in a data center, or hosted in the cloud such as EC2??
I taught of something like private cloud for company, because it's really annoying to manage all deploys by connecting trough ssh etc. we already have gitlab with ci but i wanted a deploy environment, so i will probably use dokku.
They've done a great job of documentation and on-boarding new people to try it out.
They have a nice set of ansible scripts or docker images which will get you up and running pretty quickly[1].
I currently run a lot of stuff in Azure, and there is a great deployment template to get your orgin cluster up and running here [2]
Underneath the hood it is just docker, kubernetes, and some other goodness. Color me super impressed with this.
Note, for something way, way, more simple I highly recomment Dokku [3]
[1] - https://github.com/openshift/openshift-ansible
[2] - https://github.com/derdanu/azure-openshift
[3] - https://github.com/dokku/dokku