Unfair to link everything to ASWJ’s Ludhianvi: Nisar