The only problem I see with weed is the smoke. Some people don't want to smell it. Other than that...

I don't anticipate fights outside the coffeehouses at closing time like at bars but I've never been to Amsterdam so I don't really know what it's like where they have them.