Search
Results
-
A Fair and Resilient Decentralized Clock Network for Transaction Ordering
(2024)Leibniz International Proceedings in Informatics (LIPIcs) ~ 27th International Conference on Principles of Distributed Systems (OPODIS 2023)Traditional blockchain design gives miners or validators full control over transaction ordering, i.e., they can freely choose which transactions to include or exclude, as well as in which order. While not an issue initially, the emergence of decentralized finance has introduced new transaction order dependencies allowing parties in control of the ordering to make a profit by front-running others’ transactions. In this work, we present the ...Conference Paper -
DeFi Lending During The Merge
(2023)Leibniz International Proceedings in Informatics (LIPIcs) ~ 5th Conference on Advances in Financial Technologies (AFT 2023)Lending protocols in decentralized finance enable the permissionless exchange of capital from lenders to borrowers without relying on a trusted third party for clearing or market-making. Interest rates are set by the supply and demand of capital according to a pre-defined function. In the lead-up to The Merge: Ethereum blockchain's transition from proof-of-work (PoW) to proof-of-stake (PoS), a fraction of the Ethereum ecosystem announced ...Conference Paper -
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks
(2022)Findings of the Association for Computational Linguistics: NAACL 2022In this paper, we present an approach to improve the robustness of BERT language models against word substitution-based adversarial attacks by leveraging adversarial perturbations for self-supervised contrastive learning. We create a word-level adversarial attack generating hard positives on-the-fly as adversarial examples during contrastive learning. In contrast to previous works, our method improves model robustness without using any ...Conference Paper -
On Isotropy Calibration of Transformers
(2022)Proceedings of the Third Workshop on Insights from Negative Results in NLPDifferent studies of the embedding space of transformer models suggest that the distribution of contextual representations is highly anisotropic - the embeddings are distributed in a narrow cone. Meanwhile, static word representations (e.g., Word2Vec or GloVe) have been shown to benefit from isotropic spaces. Therefore, previous work has developed methods to calibrate the embedding space of transformers in order to ensure isotropy. However, ...Conference Paper -
TempCaps: A Capsule Network-based Embedding Model for Temporal Knowledge Graph Completion
(2022)Proceedings of the Sixth Workshop on Structured Prediction for NLPTemporal knowledge graphs store the dynamics of entities and relations during a time period. However, typical temporal knowledge graphs often suffer from incomplete dynamics with missing facts in real-world scenarios. Hence, modeling temporal knowledge graphs to complete the missing facts is important. In this paper, we tackle the temporal knowledge graph completion task by proposing TempCaps, which is a Capsule network-based embedding ...Conference Paper -
Word2Course: Creating Interactive Courses from as Little as a Keyword
(2022)CSEDU: Proceedings of the 14th International Conference on Computer Supported EducationIn this work, we introduce a novel pipeline that enables the generation of multiple-choice questions and exercises from as little as a topic keyword. Hence, providing users the possibility to start with a study objective in mind and then automatically generate personalized learning material. The main contributions of this project are a scraper that can extract relevant information from websites, a novel distractor generation method that ...Conference Paper -
Beyond prompting: Making Pre-trained Language Models Better Zero-shot Learners by Clustering Representations
(2022)Proceedings of the 2022 Conference on Empirical Methods in Natural Language ProcessingRecent work has demonstrated that pre-trained language models (PLMs) are zero-shot learners. However, most existing zero-shot methods involve heavy human engineering or complicated self-training pipelines, hindering their application to new situations. In this work, we show that zero-shot text classification can be improved simply by clustering texts in the embedding spaces of PLMs. Specifically, we fit the unlabeled texts with a Bayesian ...Conference Paper -
A Plug-and-Play Method for Controlled Text Generation
(2021)Findings of the Association for Computational Linguistics: EMNLP 2021Large pre-trained language models have repeatedly shown their ability to produce fluent text. Yet even when starting from a prompt, generation can continue in many plausible directions. Current decoding methods with the goal of controlling generation, e.g., to ensure specific words are included, either require additional models or fine-tuning, or work poorly when the task at hand is semantically unconstrained, e.g., story generation. In ...Conference Paper -
KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation
(2021)Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language ProcessingWe present Knowledge Enhanced Multimodal BART (KM-BART), which is a Transformer-based sequence-to-sequence model capable of reasoning about commonsense knowledge from multimodal inputs of images and texts. We adapt the generative BART architecture (Lewis et al., 2020) to a multimodal model with visual and textual inputs. We further develop novel pretraining tasks to improve the model performance on the Visual Commonsense Generation (VCG) ...Conference Paper -
Using Deep Learning to Classify Saccade Direction from Brain Activity
(2021)ETRA '21 Short Papers: ACM Symposium on Eye Tracking Research and ApplicationsWe present first insights into our project that aims to develop an Electroencephalography (EEG) based Eye-Tracker. Our approach is tested and validated on a large dataset of simultaneously recorded EEG and infrared video-based Eye-Tracking, serving as ground truth. We compared several state-of-the-art neural network architectures for time series classification: InceptionTime, EEGNet, and investigated other architectures such as convolutional ...Conference Paper