I think we all agree that the biggest factor regarding the safety of these aircraft is the pilot. Whether he or she can cope with the higher speeds, etc., is important; but more important is their expectation of what they and their planes are capable of.
On the Lancair board there’s a thread called “No more commercial” in which pilots describe how much less they use the airlines now that they have their own planes which can get them where they want to go with much less hassle and sometimes even faster. But the thread also illustrates the fact that more and more pilots will expect these planes to get them where they want, when they want. These modern aircraft look more and more like airliners in terms of their navigational capabilities, but there are two big differences: the robustness of the plane and the skill of the pilot. The plane lacks the systems redundancy (multi-engines, multi-generators, etc.) and the all-weather capabilities (known icing, turbulence tolerance, ability to fly above the weather, etc.) of the “big iron,” and the pilots, by-and-large, lack the experience, proficiency, and flight support that airline pilots have (not to mention the copilots!). These differences are what allow the airlines to get you there pretty much any time in pretty much any weather. To expect the Lancair or Cirrus to do the same, especially with a less proficient pilot up front, will inevitably lead to trouble.