Designers often use physical hand-drawn mockups to convey their ideas to stakeholders. Unfortunat... more Designers often use physical hand-drawn mockups to convey their ideas to stakeholders. Unfortunately, these sketches do not depict the exact final look and feel of web pages, and communication errors will often occur, resulting in prototypes that do not reflect the stakeholder’s vision. Multiple suggestions exist to tackle this problem, mainly in the translation of visual mockups to prototypes. Some authors propose end-to-end solutions by directly generating the final code from a single (black-box) Deep Neural Network. Others propose the use of object detectors, providing more control over the acquired elements but missing out on the mockup’s layout. Our approach provides a real-time solution that explores: (1) how to achieve a large variety of sketches that would look indistinguishable from something a human would draw, (2) a pipeline that clearly separates the different responsibilities of extracting and constructing the hierarchical structure of a web mockup, (3) a methodol ogy to segment and extract containers from mockups, (4) the usage of in-sketch annotations to provide more flexibility and control over the generated artifacts, and (5) an assessment of the synthetic dataset impact in the ability to recognize diagrams actually drawn by humans. We start by presenting an algorithm that is capable of generating synthetic mockups. We trained our model (N=8400, Epochs=400) and subsequently fine-tuned it (N=74, Epochs=100) using real human-made diagrams. We accomplished a mAP of 95.37%, with 90% of the tests taking less than 430ms on modest commodity hardware (≈ 2.3fps). We further provide an ablation study with well-known object detectors to evaluate the synthetic dataset in isolation, showing that the generator achieves a mAP score of 95%, ≈1.5× higher than training using hand-drawn mockups alone.
The quantity and complexity that end-users are increasingly demanding from their applications and... more The quantity and complexity that end-users are increasingly demanding from their applications and devices makes it impractical for a software developer to “foresee” every possible combination and explore every valid alternative. One solution is to empower end-users with tools that allows them to explore their necessities in a collaborative framework, where novices and experts can co-exist and share.
This paper reports on the implementation of a cooperative personal agenda integrated into a colla... more This paper reports on the implementation of a cooperative personal agenda integrated into a collaborative team environment. Concerning developers, traditional project management tools are mainly focused on tasks exclusively related to the project, failing to provide users with the capability of managing tasks not necessarily associated with the work at hand. Scheduling tasks from divergent domains towards a more efficient user planning becomes unfeasible. To overcome this inaptness, we have extended the Redmine platform with an ...
Abstract The 7th International Conference on Quality in Information and Communication Technologie... more Abstract The 7th International Conference on Quality in Information and Communication Technologies (QUATIC) took place at the Faculty of Engineering of the University of Porto, in Portugal, from 29 September to 1 October 2010. The first day was dedicated to several parallel thematic tracks, each exploring one aspect of quality. This short report summarizes the paper presentations in the'Quality Evolution in ICT'track and the ensuing discussion. The QUATIC proceedings, which include all thematic track papers, are published by IEEE.
Designers often use physical hand-drawn mockups to convey their ideas to stakeholders. Unfortunat... more Designers often use physical hand-drawn mockups to convey their ideas to stakeholders. Unfortunately, these sketches do not depict the exact final look and feel of web pages, and communication errors will often occur, resulting in prototypes that do not reflect the stakeholder’s vision. Multiple suggestions exist to tackle this problem, mainly in the translation of visual mockups to prototypes. Some authors propose end-to-end solutions by directly generating the final code from a single (black-box) Deep Neural Network. Others propose the use of object detectors, providing more control over the acquired elements but missing out on the mockup’s layout. Our approach provides a real-time solution that explores: (1) how to achieve a large variety of sketches that would look indistinguishable from something a human would draw, (2) a pipeline that clearly separates the different responsibilities of extracting and constructing the hierarchical structure of a web mockup, (3) a methodol ogy to segment and extract containers from mockups, (4) the usage of in-sketch annotations to provide more flexibility and control over the generated artifacts, and (5) an assessment of the synthetic dataset impact in the ability to recognize diagrams actually drawn by humans. We start by presenting an algorithm that is capable of generating synthetic mockups. We trained our model (N=8400, Epochs=400) and subsequently fine-tuned it (N=74, Epochs=100) using real human-made diagrams. We accomplished a mAP of 95.37%, with 90% of the tests taking less than 430ms on modest commodity hardware (≈ 2.3fps). We further provide an ablation study with well-known object detectors to evaluate the synthetic dataset in isolation, showing that the generator achieves a mAP score of 95%, ≈1.5× higher than training using hand-drawn mockups alone.
The quantity and complexity that end-users are increasingly demanding from their applications and... more The quantity and complexity that end-users are increasingly demanding from their applications and devices makes it impractical for a software developer to “foresee” every possible combination and explore every valid alternative. One solution is to empower end-users with tools that allows them to explore their necessities in a collaborative framework, where novices and experts can co-exist and share.
This paper reports on the implementation of a cooperative personal agenda integrated into a colla... more This paper reports on the implementation of a cooperative personal agenda integrated into a collaborative team environment. Concerning developers, traditional project management tools are mainly focused on tasks exclusively related to the project, failing to provide users with the capability of managing tasks not necessarily associated with the work at hand. Scheduling tasks from divergent domains towards a more efficient user planning becomes unfeasible. To overcome this inaptness, we have extended the Redmine platform with an ...
Abstract The 7th International Conference on Quality in Information and Communication Technologie... more Abstract The 7th International Conference on Quality in Information and Communication Technologies (QUATIC) took place at the Faculty of Engineering of the University of Porto, in Portugal, from 29 September to 1 October 2010. The first day was dedicated to several parallel thematic tracks, each exploring one aspect of quality. This short report summarizes the paper presentations in the'Quality Evolution in ICT'track and the ensuing discussion. The QUATIC proceedings, which include all thematic track papers, are published by IEEE.
Uploads
Papers by Hugo Ferreira