Swordfish is not considered kosher. Why? Because it does not have the kind of scales required for kosher fish. Only scales that can be easily removed from the fish without ripping the skin are recognized as scales for kosher purposes. Since swordfish scales cannot be removed in this manner (when they are even present), the fish is not considered kosher.
For more, see All About Kosher Fish.

I find issue with this decision since, if you've ever caught an swordfish, you'd find that it takes no ripping to remove the scales and your entire boat and self would be covered in thousands of little silvery scales whether you liked it or not.